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Preface 


Welcome to Elementary Linear Algebra, Eighth Edition. I am proud to present to you this new edition. As with 
all editions, I have been able to incorporate many useful comments from you, our user. And while much has 
changed in this revision, you will still find what you expect—a pedagogically sound, mathematically precise, and 
comprehensive textbook. Additionally, I am pleased and excited to offer you something brand new— a companion 
website at LarsonLinearAlgebra.com. My goal for every edition of this textbook is to provide students with the 
tools that they need to master linear algebra. I hope you find that the changes in this edition, together with 


LarsonLinearAlgebra.com, will help accomplish just that. 


New To This Edition 


NEW LarsonLinearAlgebra.com 

This companion website offers multiple tools and 
resources to supplement your learning. Access to 
these features is free. Watch videos explaining 
concepts from the book, explore examples, download 


data sets and much more. 


True or False? In Exercises 85 and 86, determine 
whether each statement is true or false. If a statement 
is true, give a reason or cite an appropriate statement 
from the text. If a statement is false, provide an example 
that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 
85. (a) The dot product is the only inner product that can be 
defined in R". 
(b) A nonzero vector in an inner product can have a 
norm of zero. 
86. (a) The norm of the vector u is the angle between u and 
the positive x-axis. 
(b) The angle @ between a vector v and the projection 
of u onto v is obtuse when the scalar a < 0 and 
acute when a > 0, where av = proju. 


87. Let u = (4, 2) and v = (2, —2) be vectors in R? with 

the inner product (u, v) = u,v, + 2usv. 

(a) Show that u and v are orthogonal. 

(b) Sketch u and v. Are they orthogonal in the Euclidean 
sense? 

88. Proof Prove that 
la + vie + lu — vi? = Huj? + 2v 
for any vectors u and v in an inner product space V. 

89. Proof Prove that the function is an inner product on R”. 
(U, V) = cytyyy + Cattava +> © + Cly G > 0 

90. Proof Let u and v be nonzero vectors in an inner 
product space V. Prove that u — proj,u is orthogonal 
tov. 

91. Proof Prove Property 2 of Theorem 5.7: If u, v, 
and w are vectors in an inner product space V, then 
(u + v, w) = (u, w) + (v, w). 

92. Proof Prove Property 3 of Theorem 5.7: If u and v 
are vectors in an inner product space V and c is any real 
number, then (u, cv) = c(u, v). 

93. Guided Proof Let W be a subspace of the inner 
product space V. Prove that the set 
w+ = {v € V: (v, w) = 0 for all w € W} 
is a subspace of V. 

Getting Started: To prove that W+ is a subspace of 

V, you must show that W+ is nonempty and that the 

closure conditions for a subspace hold (Theorem 4.5). 

(i) Find a vector in W+ to conclude that it is nonempty. 

(ii) To show the closure of W+ under addition, you 
need to show that (v, + v», w) = 0 for all w € W 
and for any v, V, E W+. Use the properties of 
inner products and the fact that (v,, w) and (v,, w) 
are both zero to show this. 

(iii) To show closure under multiplication by a scalar, 
proceed as in part (ii). Use the properties of inner 
products and the condition of belonging to W+. 


5.2 Exercises 253 


94. Use the result of Exercise 93 to find W+ when W is the 
span of (1, 2, 3) in V = RÈ. 

95. Guided Proof Let (u, v) be the Euclidean inner 
product on R". Use the fact that (u, v) = u7v to prove 
that for any n x n matrix A, 

(a) (ATAu, v) = (u, Av) 

and 

(b) (ATAu, u) = |Aul?. 

Getting Started: To prove (a) and (b), make use of both 

the properties of transposes (Theorem 2.6) and the 

properties of the dot product (Theorem 5.3). 

(i) To prove part (a), make repeated use of the property 
(u, v} = uv and Property 4 of Theorem 2.6. 

(ii) To prove part (b), make use of the property 
(u, v) = uv, Property 4 of Theorem 2.6, and 
Property 4 of Theorem 5.3. 


INTERACTIVE EXAMPLES 
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96. CAPSTONE 

(a) Explain how to determine whether a function 
defines an inner product. 

(b) Let u and v be vectors in an inner product space V, 
such that v # 0. Explain how to find the orthogonal 


projection of u onto v. 


Finding Inner Product Weights In Exercises 97-100, 
find c, and c, for the inner product of R?, 


(u, v) = ery + cuy, 


such that the graph represents a unit circle as shown. 


101. Consider the vectors 
u = (6, 2, 4) and v = (1, 2,0) 
from Example 10. Without using Theorem 5.9, show 
that among all the scalar multiples cv of the vector 
v, the projection of u onto v is the vector closest to 
u—that is, show that d(u, projyu) is a minimum. 


REVISED Exercise Sets 


The exercise sets have been carefully and extensively 
examined to ensure they are rigorous, relevant, and 
cover all the topics necessary to understand the 
fundamentals of linear algebra. The exercises are 
ordered and titled so you can see the connections 
between examples and exercises. Many new skill- 
building, challenging, and application exercises have 
been added. As in earlier editions, the following 
pedagogically-proven types of exercises are included. 


True or False Exercises 


Proofs 
Guided Proofs 
Writing Exercises 


Technology Exercises (indicated throughout the 


text with AB) 


Exercises utilizing electronic data sets are indicated 
by © and found at CengageBrain.com. 
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x Preface 


Table of Contents Changes 
Based on market research and feedback from users, 
Section 2.5 in the previous edition (Applications of E 


Matrices 


Matrix Operations) has been expanded from one section 2.1 Operations with Matrices 
to two sections to include content on Markov chains. 2.2 Properties of Matrix Operations 
r é : R 2.3. The Inverse of a Matrix 
So now, Chapter 2 has two application sections: 24 Elementary Matrices 
2.5 Markov Chains 


Section 2.5 (Markov Chains) and Section 2.6 (More 
Applications of Matrix Operations). In addition, 
Section 7.4 (Applications of Eigenvalues and 
Eigenvectors) has been expanded to include content 
on constrained optimization. 


More Applications of Matrix Operations 


Trusted Features 
Œ CalcChat° 


For the past several years, an independent website— 
CalcChat.com—has provided free solutions to all 
odd-numbered problems in the text. Thousands of 
students have visited the site for practice and help 
with their homework from live tutors. You can also 
use your smartphone’s QR Code® reader to scan the 
icon tae at the beginning of each exercise set to 


Computational Fluid Dynamics (p. 79) 


access the solutions. 


Information Retrieval (p. 58) 


Flight Crew Scheduling (p. 47) 
39 
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62 Chapter 2 Matrices 


2.3 The Inverse of a Matrix | 


I Find the inverse of a matrix (if it exists). 


Chapter Openers 


| Use properties of inverse matrices. 


| Use an inverse matrix to solve a system of linear equations. 


MATRICES AND THEIR INVERSES 


Section 2.2 discussed some of the similarities between the algebra of real numbers and 
the algebra of matrices. This section further develops the algebra of matrices to include 
the solutions of matrix equations involving matrix multiplication. To begin, consider 
the real number equation ax = b. To solve this equation for x, multiply both sides of 
the equation by a`! (provided a + 0). 


ax=b 
(a~'a)x = a~'b 
(1)x = a™'b 
x=a'b 
The number a~! is the multiplicative inverse of a because a~'a = | (the identity 
element for multiplication). The definition of the multiplicative inverse of a matrix is 


similar. 


Definition of the Inverse of a Matrix 


An n x n matrix A is invertible (or nonsingular) when there exists an n x n 
matrix B such that 

AB = BA =I, 
where /, is the identity matrix of order n. The matrix B is the (multiplicative) 
inverse of A. A matrix that does not have an inverse is noninvertible (or 
singular). 


Nonsquare matrices do not have inverses. To see this, note that if A is of size 
m xn and B is of size n x m (where m # n), then the products AB and BA are of 
different sizes and cannot be equal to each other. Not all square matrices have inverses. 
(See Example 4.) The next theorem, however, states that if a matrix does have an 
inverse, then that inverse is unique. 


THEOREM 2.7 Uniqueness of an Inverse Matrix 


If A is an invertible matrix, then its inverse is unique. The inverse of A is 
denoted by A~!. 


PROOF 
If A is invertible, then it has at least one inverse B such that 


AB =1= BA. 
Assume that A has another inverse C such that 
AC =1= CA, 


Demonstrate that B and C are equal, as shown on the next page. 


Each Chapter Opener highlights five real-life 
applications of linear algebra found throughout the 
chapter. Many of the applications reference the 
Linear Algebra Applied feature (discussed on the 
next page). You can find a full list of the 
applications in the Index of Applications on the 
inside front cover. 


Section Objectives 

A bulleted list of learning objectives, located at 
the beginning of each section, provides you the 
opportunity to preview what will be presented 
in the upcoming section. 


Theorems, Definitions, and 
Properties 

Presented in clear and mathematically precise 
language, all theorems, definitions, and properties 
are highlighted for emphasis and easy reference. 


Proofs in Outline Form 

In addition to proofs in the exercises, some 
proofs are presented in outline form. This omits 
the need for burdensome calculations. 


QR Code is a registered trademark of Denso Wave Incorporated 
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Discovery 


Using the Discovery feature helps you develop 
an intuitive understanding of mathematical 
concepts and relationships. 


Technology Notes 


Preface 


EXAMPLE 4 Finding a Transition Matrix 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


Find the transition matrix from B to B’ for the bases for R? below. 


B = {(1, 0, 0), (0, 1, 0), (0,0, 1)} and BY = {(1,0, 1), (0, — 1, 2), (2, 3, —5)} 


SOLUTION 
Technology notes show how you can use First use the vectors in the two bases to form the matrices B and B’. 
graphing utilities and software programs SCOVERY P e a E BEE EE 
gi ‘ : « Let B = {(1, 0), (1, 2) P 
appropriately in the problem-solving process. nde a 0), (0, a o o 1 1 2 -5 
Many of the Technology notes reference the pe matrix age the matrix [B’ B] and use Gauss-Jordan elimination to rewrite [B’ B] as 
Technology Guide at CengageBrain.com. 2. Make a conjecture 1 0 2 1 0 0 1 0 0-1 4 2 
about the necessity of S xX 
using Gauss-Jordan g 1 2 9 1 Ol tat. [0 l 7 a 7 3 
sates l 1 2-5 0 0 1 0 0 1 1 -2 =i 
elimination to obtain 
the transition matrix From this, you can conclude that the transition matrix from B to B' is 
P~ when the change N 
of basis is from a a = + a 
SOLUTION nonstandard basis to oe : K Zi d 


Notice that three of the entries in tl 
the work in the expansion, use the 


|A| = 3(C,3) + O(C,3) + O(CY 


a standard basis. 


Multiply P~! by the coordinate matrix of x = [1 2 —1]" to see that the result is the 
same as that obtained in Example 3. 


TECHNOLOGY 
Many graphing utilities and determinant of the resulting matrix. 
software programs can 
find the determinant of a 1 2 
a square matrix. If you use C= (C0 0 2 3 
a graphing utility, then you may 3 4 29) 


see something similar to the 
screen below for Example 4. 1 1 
The Technology Guide at =| 0 2 
CengageBrain.com can help 3 4 
you use technology to find a 
determinant. 


1 
cn = OCD 


| + (2-242 


= 0 + 2(1)(—4) + 3(—1)(-7) 
= 13. 


You obtain 


|A| = 3(13) 


The cofactors C,;, C33, and C43 have zero coefficients, so you need only find the 
cofactor C;;. To do this, delete the first row and third column of A and evaluate the 


Delete Ist row and 3rd column. 


Simplify. 


Expanding by cofactors in the second row yields 


— 


LINEAR Time-frequency analysis of irregular physiological signals, 

ALGEBRA _ Such as beat-to-beat cardiac rhythm variations (also known 
as heart rate variability or HRV), can be difficult. This is 

APPLIED because the structure of a signal can include multiple 
periodic, nonperiodic, and pseudo-periodic components. 
Researchers have proposed and validated a simplified HRV 
analysis method called orthonormal-basis partitioning and 
time-frequency representation (OPTR). This method can 
detect both abrupt and slow changes in the HRV signal's 
structure, divide a nonstationary HRV signal into segments 
that are “less nonstationary,” and determine patterns in the 
HRV. The researchers found that although it had poor time 
resolution with signals that changed gradually, the OPTR 


Test 1 
Anna 84 
Bruce 56 
Chris 78 
David 82 


Test 2 
96 
72 
83 
sH 


108 Chapter 2 Matrices 


2 Projects 


I 1 Exploring Matrix Multiplication 
‘The table shows the first two test scores for Anna, Bruce, Chris, and David. Use the 
table to create a matrix M to represent the data. Input M into a software program or 
a graphing utility and use it to answer the questions below. 


1. Which test was more difficult? Which was easier? Explain, 
2. How would you rank the performances of the four students? 

3. Describe the meanings of the matrix products mol and ut} 

4. Describe the meanings of the matrix products [1 0 0 OJM and[0 0 1 OM. 
5. Describe the meanings of the matrix products DH and ZH! 


6. Describe the meanings of the matrix products [1 1 1 1]M andį[1 1 1 1]M. 


1 
8. Use matrix multiplication to find the combined overall average score on 
both tests. 
9. How could you use matrix multiplication to scale the scores on test 1 by a 
factor of 1.1? 


7. Describe the meaning of the matrix product [1 1 1 um Ak 


2 Nilpotent Matrices 


Let A be a nonzero square matrix. Is it possible that a positive integer k exists such 
that At = 0? For example, find A? for the matrix 


0 1 2 
A=|0 0 1j. 
0 0 0 


A square matrix A is nilpotent of index k when A + 0, A? + O,. . ., A=! + O, 
but A‘ = O. In this project you will explore nilpotent matrices. 


1. The matrix in the example above is nilpotent. What is its index? 


FP 2. Use a software program or a graphing utility to determine which matrices below 
are nilpotent and find their indices. 


0 1 0 1 0 0 
of J of ] op] 


1 0 0 0 1 0 0 0 
(d) lk Al @]o o0 0 W o 
o w g E 
}. Find 3 x 3 nilpotent matrices of indices 2 and 3. 
|. Find 4 x 4 nilpotent matrices of indices 2, 3, and 4. 


naw 


Find a nilpotent matrix of index 5. 
. Are nilpotent matrices invertible? Prove your answer. 
When A is nilpotent, what can you say about A”? Prove your answer. 


eas 


. Show that if A is nilpotent, then Z — A is invertible. 


Su Suharto Shutter com 


method accurately represented multicomponent and abrupt 
changes in both real-life and simulated HRV signals. 
(Source: Orthonormal-Basis Partitioning and Time-Frequency 
Representation of Cardiac Rhythm Dynamics, Aysin, Benhur, et al, 
IEEE Transactions on Biomedical Engineering, 52, no. 5) 

an Kaul Shutestorkeam 


Linear Algebra Applied 

The Linear Algebra Applied feature describes a real-life 
application of concepts discussed in a section. These 
applications include biology and life sciences, business 
and economics, engineering and technology, physical 
sciences, and statistics and probability. 


Capstone Exercises 

The Capstone is a conceptual problem that synthesizes 
key topics to check students’ understanding of the 
section concepts. I recommend it. 


Chapter Projects 

Two per chapter, these offer the opportunity for group 
activities or more extensive homework assignments, 
and are focused on theoretical concepts or applications. 
Many encourage the use of technology. 
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Instructor Resources 


Media 


Instructor’s Solutions Manual 
The Jnstructor’s Solutions Manual provides worked-out solutions for all even-numbered 
exercises in the text. 


Cengage Learning Testing Powered by Cognero (ISBN: 978-1-305-65806-6) 

is a flexible, online system that allows you to author, edit, and manage test bank 
content, create multiple test versions in an instant, and deliver tests from your LMS, 
your classroom, or wherever you want. This is available online at cengage.com/login. 


Turn the Light On with MindTap for Larson’s Elementary Linear Algebra 
Through personalized paths of dynamic assignments and applications, MindTap is a 
digital learning solution and representation of your course that turns cookie cutter into 
cutting edge, apathy into engagement, and memorizers into higher-level thinkers. 


The Right Content: With MindTap’s carefully curated material, you get the 
precise content and groundbreaking tools you need for every course you teach. 


Personalization: Customize every element of your course—from rearranging 
the Learning Path to inserting videos and activities. 


Improved Workflow: Save time when planning lessons with all of the trusted, 
most current content you need in one place in MindTap. 


Tracking Students’ Progress in Real Time: Promote positive outcomes by 
tracking students in real time and tailoring your course as needed based on 
the analytics. 


Learn more at cengage.com/mindtap. 


Student Resources 


Print 


Student Solutions Manual 

ISBN-13: 978-1-305-87658-3 

The Student Solutions Manual provides complete worked-out solutions to all 
odd-numbered exercises in the text. Also included are the solutions to all 
Cumulative Test problems. 


Media 


MindTap for Larson’s Elementary Linear Algebra 

MindTap is a digital representation of your course that provides you with the tools 
you need to better manage your limited time, stay organized and be successful. 
You can complete assignments whenever and wherever you are ready to learn with 
course material specially customized for you by your instructor and streamlined in 
one proven, easy-to-use interface. With an array of study tools, you’ ll get a true 
understanding of course concepts, achieve better grades and set the groundwork 
for your future courses. 


Learn more at cengage.com/mindtap. 


CengageBrain.com 

To access additional course materials and companion resources, please visit 
CengageBrain.com. At the CengageBrain.com home page, search for the ISBN 
of your title (from the back cover of your book) using the search box at the top of 
the page. This will take you to the product page where free companion resources 
can be found. 
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2 Chapter 1 Systems of Linear Equations 


Introduction to Systems of Linear Equations 


Recognize a linear equation in n variables. 
Find a parametric representation of a solution set. 


Determine whether a system of linear equations is consistent or 
inconsistent. 


ui Use back-substitution and Gaussian elimination to solve a system 
of linear equations. 


LINEAR EQUATIONS IN n VARIABLES 


The study of linear algebra demands familiarity with algebra, analytic geometry, 
and trigonometry. Occasionally, you will find examples and exercises requiring a 
knowledge of calculus, and these are marked in the text. 

Early in your study of linear algebra, you will discover that many of the solution 
methods involve multiple arithmetic steps, so it is essential that you check your work. Use 
software or a calculator to check your work and perform routine computations. 

Although you will be familiar with some material in this chapter, you should 
carefully study the methods presented. This will cultivate and clarify your intuition for 
the more abstract material that follows. 

Recall from analytic geometry that the equation of a line in two-dimensional space 
has the form 


ax + ay =b, a, a, and b are constants. 


This is a linear equation in two variables x and y. Similarly, the equation of a plane 
in three-dimensional space has the form 


ax + ay + az =b, ay, G5, a, and b are constants. 


This is a linear equation in three variables x, y, and z. A linear equation in n variables 
is defined below. 


Definition of a Linear Equation in n Variables 


A linear equation in n variables x}, x5, .x;,. . .,x,, has the form 
dixi + axy + až +++ + + a,x, = b. 


The coefficients a,, a», a3,. . .,a, are real numbers, and the constant term b 
is a real number. The number a, is the leading coefficient, and x, is the 
leading variable. 


Linear equations have no products or roots of variables and no variables involved 
in trigonometric, exponential, or logarithmic functions. Variables appear only to the 
first power. 


EXAMPLE 1 Linear and Nonlinear Equations 


Each equation is linear. 
a. 3x + 2y =7 b. ix ty —az= /2 c. (sin m)x, — 4x, = e? 
Each equation is not linear. 


a. xy+z=2 b. eX — 2y =4 c. sinx + 2x, — 3x, = 0 P| 
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1.1 Introduction to Systems of Linear Equations 3 


SOLUTIONS AND SOLUTION SETS 


A solution of a linear equation in n variables is a sequence of n real numbers s4, S2, 
S3,. . .,8,, that satisfy the equation when you substitute the values 


Ky = Sin He = Soy Xe =H Sy 2 ey AHS 


into the equation. For example, x, = 2 and x, = 1 satisfy the equation x, + 2x, = 4. 
Some other solutions are x, = —4 and x, = 4, x, = 0 and x, = 2, and x, = —2 and 
X_ = 3. 

The set of all solutions of a linear equation is its solution set, and when you have 
found this set, you have solved the equation. To describe the entire solution set of a 
linear equation, use a parametric representation, as illustrated in Examples 2 and 3. 


EXAMPLE 2 Parametric Representation of a Solution Set 


Solve the linear equation x, + 2x, = 4. 


SOLUTION 


To find the solution set of an equation involving two variables, solve for one of the 
variables in terms of the other variable. Solving for x, in terms of x,, you obtain 


x, = 4— 2x. 


In this form, the variable x, is free, which means that it can take on any real value. The 
variable x, is not free because its value depends on the value assigned to x,. To represent 
the infinitely many solutions of this equation, it is convenient to introduce a third variable 
t called a parameter. By letting x, = t, you can represent the solution set as 


x, =4-2t, x, =, fis any real number. 


To obtain particular solutions, assign values to the parameter t. For instance, t = 1 
yields the solution x, = 2 and x, = 1, and t=4 yields the solution x, = —4 
and x, = 4. 


To parametrically represent the solution set of the linear equation in Example 2 
another way, you could have chosen x, to be the free variable. The parametric 
representation of the solution set would then have taken the form 


= = 1 : 
X= S, X, = 2— 355, sis any real number. 


For convenience, when an equation has more than one free variable, choose the 
variables that occur last in the equation to be the free variables. 


EXAMPLE 3 Parametric Representation of a Solution Set 


Solve the linear equation 3x + 2y — z = 3. 
SOLUTION 


Choosing y and z to be the free variables, solve for x to obtain 


343: = ytz 
x=1- ty + 3z 
Letting y = s and z = ¢, you obtain the parametric representation 
x=1-—39+ tr, y=s, z=t 
where s and t are any real numbers. Two particular solutions are 


x=1y=0,z=0 and x=1,y=1,z=2. wl 
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4 Chapter 1 Systems of Linear Equations 


REMARK 


The double-subscript notation 
indicates a,j is the coefficient 
of x; in the ith equation. 


SYSTEMS OF LINEAR EQUATIONS 


A system of m linear equations in n variables is a set of m equations, each of which 
is linear in the same n variables: 


AXi + aX + aia% +--+ © + a,x, = bi 
aX E AX + aX + + + + + Ay Xx, = dy 
Az\X) + a3X3 + A43X3 + ` + © + A3,X, = b3 
Am1% + Am2%2 + A m3%3 Peep Amn¥n F Diy: 


A system of linear equations is also called a linear system. A solution of a linear 
system is a sequence of numbers s4, 55, 53,. . ., S, that is a solution of each equation 
in the system. For example, the system 


3x, + 2x, = 3 
—xX, + x, =4 
has x, = —1 and x, = 3 as a solution because x, = —1 and x, = 3 satisfy both 


equations. On the other hand, x, = 1 and x, = 0 is nota solution of the system because 
these values satisfy only the first equation in the system. 


DISCOVERY 


1. Graph the two lines 


3x- y=1 

2x-y=0 
in the xy-plane. Where do they intersect? How many solutions does 
this system of linear equations have? 


Repeat this analysis for the pairs of lines 


3x- y= 1 3x- y=1 
3x- y=0 and 6x — 2y=2. 


What basic types of solution sets are possible for a system of two 
linear equations in two variables? 


See LarsonLinearAlgebra.com for an interactive version of this type of exercise. 


LINEAR In a chemical reaction, atoms reorganize in one or more 
ALGEBRA substances. For example, when methane gas (CH,) 
APPLIED combines with oxygen (O,) and burns, carbon dioxide 
(CO,) and water (H,O) form. Chemists represent this 
process by a chemical equation of the form 


(x,)CH, + (x,)O,— (x3)CO, + (x,)H,O. 


A chemical reaction can neither create nor destroy atoms. 
So, all of the atoms represented on the left side of the 
arrow must also be on the right side of the arrow. This 

is called balancing the chemical equation. In the above 
example, chemists can use a system of linear equations 
to find values of x,, Xz, Xz, and x, that will balance the 
chemical equation. 


Elnur/Shutterstock.com 
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1.1 Introduction to Systems of Linear Equations 5 


It is possible for a system of linear equations to have exactly one solution, 
infinitely many solutions, or no solution. A system of linear equations is consistent 
when it has at least one solution and inconsistent when it has no solution. 


EXAMPLE 4 Systems of Two Equations in Two Variables 


Solve and graph each system of linear equations. 


axty= 3 b. x+ y=3 &xrt+ty=3 
x=y==1 2x +2y=6 x+y=1 
SOLUTION 


a. This system has exactly one solution, x = | and y = 2. One way to obtain 
the solution is to add the two equations to give 2x = 2, which implies x = 1 
and so y = 2. The graph of this system is two intersecting lines, as shown in 
Figure 1.1(a). 


b. This system has infinitely many solutions because the second equation is the result 
of multiplying both sides of the first equation by 2. A parametric representation of 
the solution set is 


x=3-t, y=f, fis any real number. 


The graph of this system is two coincident lines, as shown in Figure 1.1(b). 


c. This system has no solution because the sum of two numbers cannot be 3 and 1 
simultaneously. The graph of this system is two parallel lines, as shown in 
Figure 1.1(c). 


a. Two intersecting lines: b. Two coincident lines: c. Two parallel lines: 
x+y= 3 x+ y=3 xty=3 
x-y=-l 2x + 2y=6 xty=1 

Figure 1.1 a 


Example 4 illustrates the three basic types of solution sets that are possible for a 
system of linear equations. This result is stated here without proof. (The proof is 
provided later in Theorem 2.5.) 


Number of Solutions of a System of Linear Equations 


For a system of linear equations, precisely one of the statements below is true. 


1. The system has exactly one solution (consistent system). 
2. The system has infinitely many solutions (consistent system). 
3. The system has no solution (inconsistent system). 
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Chapter 1 Systems of Linear Equations 


SOLVING A SYSTEM OF LINEAR EQUATIONS 


Which system is easier to solve algebraically? 


x—-—2y+3z= 9 x= 2y+ 3z=9 
=a 3y = —4 y+3z=5 
2x = 5y +5z= 17 z=2 


The system on the right is clearly easier to solve. This system is in row-echelon form, 
which means that it has a “stair-step” pattern with leading coefficients of 1. To solve 
such a system, use back-substitution. 


EXAMPLE 5 Using Back-Substitution in Row-Echelon Form 


Use back-substitution to solve the system. 


x—-2y= 5 Equation 1 
y=-2 Equation 2 
SOLUTION 
From Equation 2, you know that y = — 2. By substituting this value of y into Equation 1, 
you obtain 
x= 2(=2) =5 Substitute — 2 for y. 
x=l. Solve for x. 
The system has exactly one solution: x = 1 and y = —2. m 


The term back-substitution implies that you work backwards. For instance, 
in Example 5, the second equation gives you the value of y. Then you substitute 
that value into the first equation to solve for x. Example 6 further demonstrates this 
procedure. 


EXAMPLE 6 Using Back-Substitution in Row-Echelon Form 


Solve the system. 


x— 2y + 3z=9 Equation 1 
y+3z=5 Equation 2 
z=2 Equation 3 

SOLUTION 


From Equation 3, you know the value of z. To solve for y, substitute z = 2 into 
Equation 2 to obtain 


y+32)= 5 Substitute 2 for z. 
y= -l1. Solve for y. 
Then, substitute y = — 1 and z = 2 in Equation 1 to obtain 
x — 2(-1) + 3(2)=9 Substitute — 1 for y and 2 for z. 
x= 1. Solve for x. 
The solution is x = 1, y = —1, and z = 2. | 


Two systems of linear equations are equivalent when they have the same solution 
set. To solve a system that is not in row-echelon form, first rewrite it as an equivalent 
system that is in row-echelon form using the operations listed on the next page. 
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Carl Friedrich Gauss 
(1777-1855) 

German mathematician 
Carl Friedrich Gauss is 
recognized, with Newton 
and Archimedes, as one 
of the three greatest 
mathematicians in history. 
Gauss used a form of what 
is now known as Gaussian 
elimination in his research. 
Although this method was 
named in his honor, the 
Chinese used an 
almost identical . 
method some man 
2000 years prior W2% 


AT 
to Gauss. oles ‘ 


Figure 1.2 
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Operations That Produce Equivalent Systems 


Each of these operations on a system of linear equations produces an equivalent 
system. 


1. Interchange two equations. 
2. Multiply an equation by a nonzero constant. 
3. Add a multiple of an equation to another equation. 


Rewriting a system of linear equations in row-echelon form usually involves 
a chain of equivalent systems, using one of the three basic operations to obtain 
each system. This process is called Gaussian elimination, after the German 
mathematician Carl Friedrich Gauss (1777-1855). 


J Using Elimination to Rewrite 
EXAMPLE 7 a System in Row-Echelon Form 
See LarsonLinearAlgebra.com for an interactive version of this type of example. 


Solve the system. 


x—2y+3z= 9 
=% 3y = —4 
2x = 5y + 5z= 17 


SOLUTION 


Although there are several ways to begin, you want to use a systematic procedure 
that can be applied to larger systems. Work from the upper left corner of the 
system, saving the x at the upper left and eliminating the other x-terms from the 
first column. 


x= 2y +3z= 9 Adding the first equation to 
y+3z= 5 ~<&— the second equation produces 
2% = 5y + 5z = 17 a new second equation. 


x—2dy+3z= 9 Adding —2 times the first 
y + 3z equation to the third equation 
-y- z=-l < produces a new third equation. 


Now that you have eliminated all but the first x from the first column, work on the 
second column. 


x— dy + 3z=9 Adding the second equation to 
ye = the third equation produces 
Iz =4 <a new third equation. 


x— 2y + 3z= 9 Multiplying the third equation 
y+ 3z=5 by 5 produces a new third 
z=2 <= =—s equation. 


This is the same system you solved in Example 6, and, as in that example, the solution is 


221, poe 22a. a 


Each of the three equations in Example 7 represents a plane in a three-dimensional 
coordinate system. The unique solution of the system is the point (x, y, z) = (1, — 1, 2), 
so the three planes intersect at this point, as shown in Figure 1.2. 


Nicku/Shutterstock.com 
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Chapter 1 Systems of Linear Equations 


Many steps are often required to solve a system of linear equations, so it is 
very easy to make arithmetic errors. You should develop the habit of checking your 
solution by substituting it into each equation in the original system. For instance, 
in Example 7, check the solution x = 1, y = —1, and z = 2 as shown below. 


Equation 1: (1) — 2(-1) + 32)= 9 Substitute the solution 
Equation 2: — (1) + 3(—1) = —4 into each equation of the 
Equation 3: 2(1) — 5(—1) + 5(2) = 17 onieitiall Syston. 


The next example involves an inconsistent system—one that has no solution. 
The key to recognizing an inconsistent system is that at some stage of the Gaussian 
elimination process, you obtain a false statement such as 0 = —2. 


EXAMPLE 8 An Inconsistent System 


Solve the system. 


x, —-3x,+ x,= 1 
2X, = Xy — 2X4. = 
x F 2xy = 3x5= = 1 
SOLUTION 
x, T 3x, + X= 1 Adding — 2 times the first 
5x, — 4x = 0 << equation to the second equation 
x, + 2x, — 3x; = -1 produces a new second equation. 


3+ X= l Adding — 1 times the first 
5x, — 4x; = 0 equation to the third equation 


5x, — 4x, = —2 ~<€& produces a new third equation. 


(Another way of describing this operation is to say that you subtracted the first 
equation from the third equation to produce a new third equation.) 


my Bg = l Subtracting the second equation 


5x, — 443 = 0 from the third equation produces 
0=—2 <= anew third equation. 


The statement 0 = —2 is false, so this system has no solution. Moreover, this system 
is equivalent to the original system, so the original system also has no solution. | 


As in Example 7, the three equations in 
Example 8 represent planes in a three-dimensional 
coordinate system. In this example, however, the 
system is inconsistent. So, the planes do not have a 
point in common, as shown at the right. 


TEMEN) 
p”, 
I 
aa 
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1.1 Introduction to Systems of Linear Equations 9 


This section ends with an example of a system of linear equations that has infinitely 
many solutions. You can represent the solution set for such a system in parametric 
form, as you did in Examples 2 and 3. 


EXAMPLE 9 | A System with Infinitely Many Solutions 


Solve the system. 


Xo = 
x, = 3x, = -1 
=X, > 3x, = | 
SOLUTION 
Begin by rewriting the system in row-echelon form, as shown below. 
x, — 3x, =—-1 <€ Interchange the first 
X,- n= O < two equations. 
=x; F 3x5 = 1 
M -3% = -1 Adding the first equation to the 
Xy— X= 0 third equation produces a new 
3x, — 3x, = 0 <€ third equation. 
xy — 3x, = -1 


Adding —3 times the second 
v= = 0 equation to the third equation 
0= 0 < eliminates the third equation. 


The third equation is unnecessary, so omit it to obtain the system shown below. 


x, = J= = 1 
y= r= 0 


To represent the solutions, choose x, to be the free variable and represent it by the 
parameter t. Because x, = x, and x, = 3x, — 1, you can describe the solution set as 


x, =3t-—1, x, =f, x; =t, fis any real number. T 


DISCOVERY 


1. Graph the two lines represented by the system of equations. 


x—2y= 1 
=2x + 3y=—-3 


2. Use Gaussian elimination to solve this system as shown below. 


x—2y= 1 

=1y==1 

x—2y=1 

REMARK yea 


You are asked to repeat this 
graphical analysis for other 
systems in Exercises 91 

and 92. Graph the system of equations you obtain at each step of this 
process. What do you observe about the lines? 


x=3 
y=1 


See LarsonLinearAlgebra.com for an interactive version of this type of exercise. 
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10 Chapter 1 Systems of Linear Equations 


1 a 1 Exercises See CalcChat.com for worked-out solutions to odd-numbered exercises. 
5 || 


Linear Equations In Exercises 1-6, determine whether Pe Graphical Analysis In Exercises 31-36, complete parts 


the equation is linear in the variables x and y. (a)-(e) for the system of equations. 
1. 2x — 3y = 4 2. 3x — 4y = 0 (a) Use a graphing utility to graph the system. 
oni eee dae * died. 
5. 2sinx — y = 14 6. (cos 3)x + y = —16 (c) If the system is consistent, approximate the solution. 


(d) Solve the system algebraically. 
Parametric Representation In Exercises 7-10, find 
a parametric representation of the solution set of the 
linear equation. 


(e) Compare the solution in part (d) with the 
approximation in part (c). What can you conclude? 


7. 2x — 4y =0 8. 3x —ly=9 31. —3x-— y=3 32. 4x- Sy= 3 
9xty+z=l 6x + 2y = 1 —8x + 10y = 14 
10. 12x, + 24x, — 36x, = 12 ee oy a ar 
ax + y=0 ax + 3y =0 
pai age oc peas ek graph the 35. 4x- 8y= 9 36. —14.7x + 2.1y = 1.05 
system of linear equations. Solve the system and 0.8x — 1.6y = 1.8 44.1x — 6.3y = —3.15 
interpret your answer. 
11. 2x +y=4 12. x+3y=2 System of Linear Equations In Exercises 37-56, solve 
x-y=2 —x+2y=3 the system of linear equations. 
13. —x + y= 1 14. ix- iy = 1 37. A7 X= (0) 38. 3x + 2y = 2 
3x —3y=4 pd tye 3X, = 2%) = =1 6x + 4y = 14 
15. 3x — 5y = 7 16. -x + 3y = 17 39. 3u + v = 240 40. x, — 2x, =0 
It yd tye u + 3v = 240 6x, + 2x, = 0 
2 1 
17. 2x- y= 5 18. x-5y=21 ae: aaa 42. 3x, + Gt = 0 
5x-y=11 6x + 5y = 21 sx + 5y = —3 4x, + x, =0 
ees vol x-1 yt2 gg Fo Ag IT. Gg 
19. 4 + = 1 20. 5 + 3 4 4 3 
2x-y=12 x—-2y=5 x — 3y = 20 
21. 0.05x — 0.03y = 0.07 22. 0.2x — 0.5y = —27.8 yatt ntl L j 
0.07x + 0.02y = 0.16 0.3x — 0.4y = 68.7 3 2 
3x, —X%, = —-2 
x y 2x y_ 2 1 A 
23. te! 4.5 to T3 45. 0.02x, — 0.05x, = —0.19 
x-y=3 4+ y=4 0.03x, + 0.04x, = 0.52 
46. 0.05x, — 0.03x, = 0.21 
Back-Substitution In Exercises 25-30, use back- 0.07x, + 0.02x, = 0.17 
substitution to solve the system. 
7 E 47. x- y-z=0 
oe ee a al a ee ee b 
x, =3 3x, =9 2x a. 
27. -—x+ y- z=0 28. x- y = 5 48, x+ y+ z=2 
ay 2 3y + Pan =x + 3y + z =8 
z=0 4z = 8 4x+ y =A 
29. 5x, + 2x, + x3 = 0 30. x; + x, +x, =0 49. 3x, — 2x, + 4x, = 1 
2x, + x = ao =0 xit am 2x, = 3 


2x, — 3x, + 6x, = 8 


The symbol f indicates an exercise in which you are instructed to use a 
graphing utility or software program. 
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50. 5x, — 3x, + 2x, = 3 
2X, + 4x, = x, = 7 
x, — llx, + 44, = 3 
S51. 2x, + x, - 3x,= 4 


4x, + 2x,= 10 
=2x, + 3x, — 13%, = -8 
52. x, +4x,= 13 
4x, = 2x + x= 7 
2%, = 2Xy = Tx, = —19 
53. x— 3y+ 2z= 18 
5x — 15y + 10z = 18 


54. x, — 2x, + 5x% = 2 
3x, + 2x, = x, = -2 
55. x+ yt+tz+ w=6 
2x + 3y — w=0 
—3x+4y+z2+2w=4 
x+2y-—z+ w=0 


56. —x, + 2x, = 1 
4x5 = x= X= 

Xa = %=0 

J= ae F 3x5 =4 


fe System of Linear Equations In Exercises 57-62, use 
Q) a software program or a graphing utility to solve the 
= system of linear equations. 


57. 123.5x + 61.3y — 32.42 = —262.74 
54.7x — 45.6y + 98.2z = 197.4 
42.4x — 89.3y + 12.92 = 33.66 

58. 120.2x + 62.4y — 36.5z = 258.64 
56.8x — 42.8y + 27.3z = —71.44 


88.1x + 72.5y — 28.5z = 225.88 
59. xX, + 0.5x, + 0.33x, + 0.25x, = 1.1 
0.5x, + 0.33x, + 0.25x3, + 0.21x, = 1.2 
0.33x, + 0.25x, + 0.2x, + 0.17x, = 1.3 
0.25x, + 0.2x, + 0.17x, + 0.14x, = 1.4 


60. O.lx — 2.5y + 1.2z — 0.75w = 108 
24x + 1.5y — 1.8z+0.25w = —81 
0.4x — 3.2y + 1.6z 14w = 148.8 
1.6x + 1.2y — 3.27 + 0.6w = — 143.2 


1 3 2 349 
61. 3x, — 7% + 9X3 = 630 
2 4 2, — —19 
3X) + 9X — 5X3 = 45 
4 1 4. _ 139 
5X, — 8X2 + 3X3 = 150 


1 1 1 1 
62. sx — 7y + GZ - SW 


1 1 
7X + GY 5z + gw = 


a 
+ 
BI 
sd 
wl 
N 
+ 
NI 
= 
ll 


1.1 Exercises 11 


Number of Solutions In Exercises 63-66, state why 
the system of equations must have at least one solution. 
Then solve the system and determine whether it has 
exactly one solution or infinitely many solutions. 


63. 


65. 


67. 


68. 


4x + 3y + 17z =0 
5x + 4y + 22z =0 
4x + 2y + 19z =0 
5x+ Sy- z=0 
10x + Sy + 2z=0 
5x + 15y — 9z = 0 


64. 2x + 3y = 0 
4x + 3y- z=0 
8x + 3y + 3z =0 

66. 16x + 3y + z=0 
l6x + 2y —z=0 


Nutrition One eight-ounce glass of apple juice and 
one eight-ounce glass of orange juice contain a total of 
227 milligrams of vitamin C. Two eight-ounce glasses 
of apple juice and three eight-ounce glasses of orange 
juice contain a total of 578 milligrams of vitamin C. 
How much vitamin C is in an eight-ounce glass of each 
type of juice? 

Airplane Speed Two planes start from Los Angeles 
International Airport and fly in opposite directions. The 
second plane starts 5 hour after the first plane, but its 
speed is 80 kilometers per hour faster. Two hours after 
the first plane departs, the planes are 3200 kilometers 
apart. Find the airspeed of each plane. 


True or False? In Exercises 69 and 70, determine 
whether each statement is true or false. If a statement 
is true, give a reason or cite an appropriate statement 
from the text. If a statement is false, provide an example 
that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


69. 


70. 


71. 


The symbol indicates that electronic data sets for these exercises are available 


at LarsonLinearAlgebra.com. The data sets are compatible with MATLAB, 


Mathematica, Maple, TI-83 Plus, TI-84 Plus, TI-89, and Voyage 200. 


(a) A system of one linear equation in two variables is 
always consistent. 


(b) A system of two linear equations in three variables 
is always consistent. 

(c) If a linear system is consistent, then it has infinitely 
many solutions. 

(a) A linear system can have exactly two solutions. 

(b) Two systems of linear equations are equivalent 
when they have the same solution set. 


(c) A system of three linear equations in two variables 
is always inconsistent. 


Find a system of two equations in two variables, x, and 
X», that has the solution set given by the parametric 
representation x, = f and x, = 3t — 4, where t is any 
real number. Then show that the solutions to the system 
can also be written as 


and x, =t. 


Copyright 2017 Cengage Learning. All Rights Reserved. May not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eBook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage Learning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


12 Chapter 1 Systems of Linear Equations 


72. Find a system of two equations in three variables, 
Xi X,, and x3, that has the solution set given by the 
parametric representation 
x, =f, xy =s, and %=3+5-¢t 


where s and f are any real numbers. Then show that the 
solutions to the system can also be written as 


x =3+5s-t, x, =s, and x,=t. 


Substitution In Exercises 73-76, solve the system 
of equations by first letting A = 1/x, B =1/y, and 
C=1/z. 


73, -Boy m4, 242= -1 
x y x y 
vi ae 2_3__17 
x y x y 6 
D 2+ -32 4 Mariste 5 
wo g Z x y z 
i ploi o ey 
x Z x y 
2,3 B g 241432 9 
xX y Z xo y Z 


Trigonometric Coefficients In Exercises 77 and 78, 
solve the system of linear equations for x and y. 
77. (cos @)x + (sin @)y = 1 
(—sin 0)x + (cos @)y = 0 
78. (cos @)x + (sin @)y = 1 
(—sin @)x + (cos @)y = 1 


Coefficient Design In Exercises 79-84, determine the 
value(s) of k such that the system of linear equations has 
the indicated number of solutions. 


79. No solution 80. Exactly one solution 


x+ ky=2 x+ky=0 
kx+ y=4 kx + y=0 

81. Exactly one solution 82. No solution 
kx + 2ky + 3kz = 4k x+2y+kz=6 


x+ yt z= 0 3x + 6y + 8z = 4 


2x- yt z= 1 
83. Infinitely many solutions 
4x +ky= 6 
kx + y=-3 
84. Infinitely many solutions 
kx+ y= 16 
3x — 4y = — 64 


85. Determine the values of k such that the system of linear 
equations does not have a unique solution. 
x+ ytkz=3 
x+ ky+ z=2 
kx+ y+ z=1 


86. CAPSTONE Find values of a, b, and c such 
that the system of linear equations has (a) exactly 
one solution, (b) infinitely many solutions, and 
(c) no solution. Explain. 


x+5y+ z=0 
x+6y- z=0 
2x + ay + bz=c 


87. Writing Consider the system of linear equations in x 
and y. 
ax + biy =c; 

a,x + bay = c3 

a,x + bsy = c3 

Describe the graphs of these three equations in the 
xy-plane when the system has (a) exactly one solution, 
(b) infinitely many solutions, and (c) no solution. 

88. Writing Explain why the system of linear equations 
in Exercise 87 must be consistent when the constant 
terms c}, C>, and c, are all zero. 

89. Show that if ax? + bx+c=0 for all x, then 
a=b=c=0. 

90. Consider the system of linear equations in x and y. 


ax + by =e 
cx + dy =f 


Under what conditions will the system have exactly one 
solution? 


Discovery In Exercises 91 and 92, sketch the lines 
represented by the system of equations. Then use 
Gaussian elimination to solve the system. At each step of 
the elimination process, sketch the corresponding lines. 
What do you observe about the lines? 


91. x-4 = -3 92. 2x-—3y= 7 
5x — 6y = 13 —4x + 6y = -14 


Writing In Exercises 93 and 94, the graphs of the 
two equations appear to be parallel. Solve the system 
of equations algebraically. Explain why the graphs are 
misleading. 


93. 100y —x = 200 
99y — x = — 198 


94. 21x — 20y= 0 
13x — 12y = 120 
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1.2 Gaussian Elimination and Gauss-Jordan Elimination 


REMARK 


The plural of matrix is matrices. 


When each entry of a matrix is 
a real number, the matrix 

is a real matrix. Unless stated 
otherwise, assume all matrices 
in this text are real matrices. 


REMARK 


Begin by aligning the variables 
in the equations vertically. Use 
0 to show coefficients of zero 
in the matrix. Note the fourth 
column of constant terms in 
the augmented matrix. 


Determine the size of a matrix and write an augmented or 
coefficient matrix from a system of linear equations. 


Use matrices and Gaussian elimination with back-substitution 

to solve a system of linear equations. 

wi Use matrices and Gauss-Jordan elimination to solve a system 
of linear equations. 


zi Solve a homogeneous system of linear equations. 


MATRICES 


Section 1.1 introduced Gaussian elimination as a procedure for solving a system of 
linear equations. In this section, you will study this procedure more thoroughly, 
beginning with some definitions. The first is the definition of a matrix. 


Definition of a Matrix 


If m and n are positive integers, then an m x n (read “m by n”) matrix is a rectangular 
array 
Column 1 Column2 Column 3 Fei Column n 
Row 1 Pe Ain 
Row 2 tee Aan 


Row 3 3 tiop a3n 


Row m a a a a 


ml m2 m3 ia mn 


in which each entry, a;;, of the matrix is a number. An m x n matrix has m rows 
and n columns. Matrices are usually denoted by capital letters. 


The entry a; is located in the ith row and the jth column. The index i is called the 
row subscript because it identifies the row in which the entry lies, and the index j is 
called the column subscript because it identifies the column in which the entry lies. 

A matrix with m rows and n columns is of size m x n. When m = n, the matrix is 
square of order n and the entries a), 422, 433,- . ., A,n are the main diagonal entries. 


EXAMPLE 1 Sizes of Matrices 


Each matrix has the indicated size. 


a 0 OJ a, e 2 sae... 
a. [2] Size: 1 x 1 b. FE | Size:2 x2 e É Ji 1 aa" 


One common use of matrices is to represent systems of linear equations. The 
matrix derived from the coefficients and constant terms of a system of linear equations 
is the augmented matrix of the system. The matrix containing only the coefficients of 
the system is the coefficient matrix of the system. Here is an example. 


System Augmented Matrix Cofficient Matrix 
x—4y+3z= 5 1 —4 3 5 1 —4 3 
=% + 3y = z=-3 = se 3 = a. =l 
2x, —4z= 6 2 0 -4 6 2 0 -4 
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TECHNOLOGY 


Many graphing utilities and 
software programs can perform 
elementary row operations on 
matrices. If you use a graphing 
utility, you may see something 
similar to the screen below for 
Example 2(c). The Technology 
Guide at CengageBrain.com 
can help you use technology 
to perform elementary row 
operations. 


oi) 2 =A 4 1 
K@ 3 oce = 
IZ i S seal 


mRAdd(-2, A, 1,3) 
Hoi) 2 =4 3 
0) a =2 14 
[Ro =8} 41S) 3} ala 


ELEMENTARY ROW OPERATIONS 


In the previous section, you studied three operations that produce equivalent systems 
of linear equations. 


1. Interchange two equations. 
2. Multiply an equation by a nonzero constant. 
3. Add a multiple of an equation to another equation. 


In matrix terminology, these three operations correspond to elementary row operations. 
An elementary row operation on an augmented matrix produces a new augmented matrix 
corresponding to a new (but equivalent) system of linear equations. Two matrices are 
row-equivalent when one can be obtained from the other by a finite sequence of 
elementary row operations. 


Elementary Row Operations 


1. Interchange two rows. 
2. Multiply a row by a nonzero constant. 
3. Add a multiple of a row to another row. 


Although elementary row operations are relatively simple to perform, they can 
involve a lot of arithmetic, so it is easy to make a mistake. Noting the elementary row 
operations performed in each step can make checking your work easier. 

Solving some systems involves many steps, so it is helpful to use a shorthand 
method of notation to keep track of each elementary row operation you perform. The 
next example introduces this notation. 


EXAMPLE 2 Elementary Row Operations 


a. Interchange the first and second rows. 


Original Matrix New Row-Equivalent Matrix Notation 
0 1 3 4 =] 2 0 3 
=1 2 0 3 0 1 3 4 R R, 
2 =3 4 1 2 =3 4 1 


b. Multiply the first row by $ to produce a new first row. 


Original Matrix New Row-Equivalent Matrix Notation 
2-4 6 -2 1 -2 3 -1 ()R, >R, 
1 3 =3 0 1 3 =3 0 
5 =2 1 2 > =2 1 2 


c. Add —2 times the first row to the third row to produce a new third row. 


Original Matrix New Row-Equivalent Matrix Notation 
1 2 -4 3 1 2 -4 3 
0 3 =2. =l 0 3 =2 =I 
2 1 5 =2 0 =3 13 =8 R, + (—2)R, >R; 
Notice that adding — 2 times row 1 to row 3 does not change row 1. | 
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In Example 7 in Section 1.1, you used Gaussian elimination with back-substitution 
to solve a system of linear equations. The next example demonstrates the matrix 
version of Gaussian elimination. The two methods are essentially the same. The basic 
difference is that with matrices you do not need to keep writing the variables. 


EXAMPLE 3- 


Linear System 
x—2y+3z= 9 
=r Sy =-4 
2x = 5y +5z= 17 
Add the first equation to the second 
equation. 
x- 2y+3z¢= 9 
y+3z= 5 
2x = 5y + 5z = 17 
Add —2 times the first equation to the 
third equation. 
x= 2y+3z= 9 
y + 3z 5 
=} — z= —] 


Add the second equation to the third 
equation. 
x— 2y + 3z=9 
y+3z=5 
2z=4 


Multiply the third equation by $, 


Using Elementary Row Operations 
to Solve a System 


Associated Augmented Matrix 


1 =2 3 9 
= 3 0 -4 
2 =5 5 17 
Add the first row to the second row to 
produce a new second row. 
1 =2 3 9 
0 1 3 5 
2. =5 5 17 


R; t Ry OR, 


Add —2 times the first row to the third 
row to produce a new third row. 


1 =2 3 9 
0 1 3 5 


0 -1 -1 -1| R +(-2R,>R, 


Add the second row to the third row to 
produce a new third row. 


1 -2 3 9 
0 1 3 5 


ô 0 2 Al) Repo 


Multiply the third row by 5 to produce 


a new third row. 


x — 2y + 3z=9 1 =2 3 9 
y+3z=5 0 1 3 5 
REMARK 2z=3 0 0 1 2| @R->R, 
The term echelon refers to the 
stair-step pattern formed by 
the nonzero elements of the 
matrix. 


Use back-substitution to find the solution, as in Example 6 in Section 1.1. The solution 
isx = 1, y= —l,andz = 2. 


The last matrix in Example 3 is in row-echelon form. To be in this form, a matrix 
must have the properties listed below. 


Row-Echelon Form and Reduced Row-Echelon Form 


A matrix in row-echelon form has the properties below. 


. Any rows consisting entirely of zeros occur at the bottom of the matrix. 

. For each row that does not consist entirely of zeros, the first nonzero entry 
is 1 (called a leading 1). 

. For two successive (nonzero) rows, the leading | in the higher row is farther 
to the left than the leading 1 in the lower row. 


A matrix in row-echelon form is in reduced row-echelon form when every column 
that has a leading 1 has zeros in every position above and below its leading 1. 


Copyright 2017 Cengage Learning. All Rights Reserved. May not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eBook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage Learning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


16 Chapter 1 


TECHNOLOGY 
Use a graphing utility or 
a software program to find 
the row-echelon forms of the 
matrices in Examples 4(b) 
and 4(e) and the reduced 
row-echelon forms of the 
matrices in Examples 4(a), 
4(b), 4(c), and 4(e). The 
Technology Guide at 
CengageBrain.com can help 
you use technology to find 
the row-echelon and reduced 


row-echelon forms of a matrix. 


Similar exercises and projects 
are also available on the 
website. 
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Systems of Linear Equations 


“EXAMPLE 4 i Row-Echelon Form 


Determine whether each matrix is in row-echelon form. If it is, determine whether the 
matrix is also in reduced row-echelon form. 


1 2 =l 4 1 2 =i 2 
a. |0 1 0 3 b. | 0 0 0 0 

0 0 L =2 0 1 2 —4 

| =5 2 =] 3 1 0 0 = 
M 0 0 1 3-2 d 0 1 0 2 
"Jo 0 0 1 4 "10 0 1 3 

0 0 0 0 1 0 0 0 0 

1 2 =3 4 0 1 0 5 
e. | 0 2 I =l f. |0 0 1 3 

0 0 I; =3 0 0 0 0 
SOLUTION 


The matrices in (a), (c), (d), and (f) are in row-echelon form. The matrices in (d) and (f) 
are in reduced row-echelon form because every column that has a leading 1 has zeros in 
every position above and below its leading 1. The matrix in (b) is not in row-echelon form 
because the row of all zeros does not occur at the bottom of the matrix. The matrix in (e) 
is not in row-echelon form because the first nonzero entry in Row 2 is not 1. | 


Every matrix is row-equivalent to a matrix in row-echelon form. For instance, in 
Example 4(e), multiplying the second row in the matrix by 5 changes the matrix to 
row-echelon form. 

The procedure for using Gaussian elimination with back-substitution is 
summarized below. 


Gaussian Elimination with Back-Substitution 


1. Write the augmented matrix of the system of linear equations. 


2. Use elementary row operations to rewrite the matrix in row-echelon form. 
3. Write the system of linear equations corresponding to the matrix in 
row-echelon form, and use back-substitution to find the solution. 


Gaussian elimination with back-substitution works well for solving systems of linear 
equations by hand or with a computer. For this algorithm, the order in which you perform 
the elementary row operations is important. Operate from left to right by columns, using 
elementary row operations to obtain zeros in all entries directly below the leading 1’s. 


LINEAR The Global Positioning System (GPS) is a network of 
ALGEBRA 24 satellites originally developed by the U.S. military as a 
APPLIED navigational tool. Today, GPS technology is used in a wide 


variety of civilian applications, such as package delivery, 
farming, mining, surveying, construction, banking, weather 
forecasting, and disaster relief. A GPS receiver works by using 
satellite readings to calculate its location. In three dimensions, 
the receiver uses signals from at least four satellites to 
“trilaterate” its position. In a simplified mathematical model, 
a system of three linear equations in four unknowns (three 
dimensions and time) is used to determine the coordinates 
of the receiver as functions of time. 


edobric/Shutterstock.com 
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EXAMPLE 5 Gaussian Elimination with Back-Substitution 


Solve the system. 


nt X5 = 25 = = 3 

Kj, F 1K. =" Ky = 2 

2x, + 4x, + xy — 3x, = —2 

xi — 4x, = Tx = x= — 19 
SOLUTION 


The augmented matrix for this system is 
0 1 I =2. =3 
1 2 =) 0 2 
2 4 1 -3 -2/ 
lL zA =T S19 


Obtain a leading 1 in the upper left corner and zeros elsewhere in the first column. 


row produces a new 
<€ fourth row. R, + (—1)R >R, 


1 2 =] 0 2| ~<€& Interchange the first 
0 1 1 -2 =3| < tworows. R OR, 
2 4 I =3 =2 
I =4_ =T -= S19 

= Adding —2 times the 
l 2 l : 2 first row to the third 
0 1 1 -2 —3 row produces a new 
0 0 3 -3 -6| <€ _ third row. R, + (—2)R, OR, 
-o S4 oS i S19 
1 2 =l 0 2 

ne _ Adding — 1 times the 

0 l l 2 ; first row to the fourth 
0 0 3423. =6 


OA -6 -6 -1 -21 


Now that the first column is in the desired form, change the second column as shown 
below. 


1 2 -=1 0 2 
= E Adding 6 times the 
t 1 l 2 3 second row to the fourth 
0 0 3 =3 =60 row produces a new 
0 0 0 —13 —39] < fourth row. R, + (6)R, >R, 


To write the third and fourth columns in proper form, multiply the third row by 1 and 
the fourth row by — 5. 


1 2 =] 0 2 Multiplying the third 

(0) 1 1 =2 =3 row by § and the fourth i 

0 0 1 -1 —2| <& = tow by -$ produces new (3)R, >R; 

0 0 0 1 3| ~<€ third and fourth rows. (- AR, >R, 


The matrix is now in row-echelon form, and the corresponding system is shown below. 


xX, + 2x, — x5 = 2 
t + x, = 2x, = —3 
k= XS =2 
x= 3 
Use back-substitution to find that the solution is x, = — 1, x, = 2, x, = 1, and x, = 3. 
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When solving a system of linear equations, remember that it is possible for the 
system to have no solution. If, in the elimination process, you obtain a row of all zeros 
except for the last entry, then it is unnecessary to continue the process. Simply conclude 
that the system has no solution, or is inconsistent. 


EXAMPLE 6 A System with No Solution 


Solve the system. 


x= x + 2x, = 4 
x, t Xq = 6 
2x, — 3x, + 5x, = 4 
3x, + 2x, - 4% = 1 
SOLUTION 
The augmented matrix for this system is 
1 =1 2 4 
1 0 1 6 
2. =3 5 4y 
3 2 =1 1 


Apply Gaussian elimination to the augmented matrix. 


1 -1 2 4 
0 1-1 2 R, + (-I)R, >R, 
2. =3 5 4 
3 2-1 1 


R, + (—2)R, > R; 


Wv” O Ohm 
| 
= 
= 
| 
A 


1 

0 

Om — 1 1 —4 

0 ` =pl R, + (—3)R,; >R, 
0 0 = 2 R, + R >R, 

0 > =) =11 

Note that the third row of this matrix consists entirely of zeros except for the last entry. 

This means that the original system of linear equations is inconsistent. To see why this 

is true, convert back to a system of linear equations. 


x= Xr 2x, = 4 
w= y= 2 
0= -2 
5r = Tx, ==11 
The third equation is not possible, so the system has no solution. m 
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REMARK 


No matter which elementary 
row operations or order you 
use, the reduced row-echelon 
form of a matrix is the same. 
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GAUSS-JORDAN ELIMINATION 


With Gaussian elimination, you apply elementary row operations to a matrix to 
obtain a (row-equivalent) row-echelon form. A second method of elimination, called 
Gauss-Jordan elimination after Carl Friedrich Gauss and Wilhelm Jordan (1842-1899), 
continues the reduction process until a reduced row-echelon form is obtained. 
Example 7 demonstrates this procedure. 


EXAMPLE 7 Gauss-Jordan Elimination 
See LarsonLinearAlgebra.com for an interactive version of this type of example. 


Use Gauss-Jordan elimination to solve the system. 


x-—2y+3z= 9 


=x Sy =-4 
2x = 5y + 5z= 17 
SOLUTION 


In Example 3, you used Gaussian elimination to obtain the row-echelon form 


i — 2 3 9 
0 1 3 5|: 
0 0 1 2 


Now, apply elementary row operations until you obtain zeros above each of the leading 
1’s, as shown below. 


9 19 R, + (2)R,>R, 
3 5 
mi 2 


19 
=1 R, + (—3)R; >R, 


1 R, + (—9)R;R, 
-1 
2 


= O O = Saco -— => 


= OO EG oV 


© 
© 


The matrix is now in reduced row-echelon form. Converting back to a system of linear 
equations, you have 


1 
yer 


z= 2. | 


The elimination procedures described in this section can sometimes result in 
fractional coefficients. For example, in the elimination procedure for the system 


2x — 5y + 5z= 14 
3x — 2y + 3z = 9 
—3x + 4y = —18 


you may be inclined to first multiply Row 1 by ; to produce a leading 1, which will 
result in working with fractional coefficients. Sometimes, judiciously choosing which 
elementary row operations you apply, and the order in which you apply them, enables 
you to avoid fractions. 
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DISCOVERY 


1. Without performing any row operations, explain why the system of 
linear equations below is consistent. 


2x, + 3x, 5x, = 0 
5x, + 6x, — 17x, = 0 
7X, — 4x% + 3x3 =0 


2. The system below has more variables than equations. Why does it 
have an infinite number of solutions? 


2x, + 3x, 5x3 2x, = 0 
5x, + 6x, — 17x3 3x, = 0 
7X, — 4x) 3x3 + 13x, = 0 


The next example demonstrates how Gauss-Jordan elimination can be used to 
solve a system with infinitely many solutions. 


EXAMPLE 8 A System with Infinitely Many Solutions 


Solve the system of linear equations. 


2x, + 4x, — 2x, = 0 
3x, + Sx, = 1 


SOLUTION 


The augmented matrix for this system is 
f 4 -2 | 
3 5 0 1] 
Using a graphing utility, a software program, or Gauss-Jordan elimination, verify that 
the reduced row-echelon form of the matrix is 


f 0 5 | 
0 t =3 =i] 


The corresponding system of equations is 


x, +5x,= 2 
xX, — 3x, = —1. 


Now, using the parameter f to represent x,, you have 


x, =2-5t, x, = —-1+3t, x, =t tis any real number. | 


Note in Example 8 that the arbitrary parameter t represents the nonleading 
variable x}. The variables x, and x, are written as functions of t. 

You have looked at two elimination methods for solving a system of linear 
equations. Which is better? To some degree the answer depends on personal preference. 
In real-life applications of linear algebra, systems of linear equations are usually 
solved by computer. Most software uses a form of Gaussian elimination, with 
special emphasis on ways to reduce rounding errors and minimize storage of data. The 
examples and exercises in this text focus on the underlying concepts, so you should 
know both elimination methods. 


Copyright 2017 C 
Editorial review ha 


gage Learning. All Ri 
ned that any suppr 


ghts Reserved. May not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eBook and/or eChapter(s). 


d content d not materially affect the overall learning experience. Cen; reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


REMARK 


A homogeneous system of 
three equations in the three 
variables x,, x,, and x, has the 
trivial solution x, = 0, x, = 0, 
and x, = 0. 
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HOMOGENEOUS SYSTEMS OF LINEAR EQUATIONS 


Systems of linear equations in which each of the constant terms is zero are called 
homogeneous. A homogeneous system of m equations in n variables has the form 


auxi T AX + digka +--+ + + a,x, = 0 


Ag 4X1 t dz% + üza +++ + + a,x, = 0 


- +a, x =0. 


amı% + An2X2 + n3X3 +: min 


A homogeneous system must have at least one solution. Specifically, if all variables in 
a homogeneous system have the value zero, then each of the equations is satisfied. Such 
a solution is trivial (or obvious). 


EXAMPLE 9 


Solve the system of linear equations. 


Solving a Homogeneous System 
of Linear Equations 


X, — X% + 3x, = 0 
2x, + x, + 3x, = 0 


SOLUTION 


Applying Gauss-Jordan elimination to the augmented matrix 
| =] 3 A 
2 1 3 0 
yields the matrices shown below. 
k =] 3 o 
0 3 =3 0 R, + (—2)R,; >R, 
1 
íl (3)R, >R, 
O 2 oO R, + R >R, 
0 i — 1 0 
The system of equations corresponding to this matrix is 
Xi + 2x, =0 
X% — Xz, = 0. 
Using the parameter t = x3, the solution set is x, = —2t, x, = t, and x, = t, where 


t is any real number. This system has infinitely many solutions, one of which is the 
trivial solution (t = 0). | 


As illustrated in Example 9, a homogeneous system with fewer equations than 
variables has infinitely many solutions. 


THEOREM 1.1 The Number of Solutions of a 
Homogeneous System 


Every homogeneous system of linear equations is consistent. Moreover, if the 
system has fewer equations than variables, then it must have infinitely many 
solutions. 


To prove Theorem 1.1, use the procedure in Example 9, but for a general matrix. 
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1 2 Exercises See CalcChat.com for worked-out solutions to odd-numbered exercises. 


Matrix Size In Exercises 1-6, determine the size of 1 2 0 1 4 
the matrix. 0 1 2 1 3 
17. 
1 2 =i - 0 0 1 2 1 
1/3 —- 6 2 0 0 0 1 4 
0 1 2 l i 2 0 1 3 
z ei? 2 zoi 
3 | ae | | 0 0 1 2 0 
—6 0 1 0 0 © 0 2 
4. [-1] ; : 
Row-Echelon Form In Exercises 19-24, determine 
8 6 4 1 3 whether the matrix is in row-echelon form. If it is, 
5 2 l =] 4 1 determine whether it is also in reduced row-echelon form. 
“Wi 1 1 2 1 1 0 0 0 
rt 2 Me %/0 1 1 2 
6. [1 2 3 4 ~-10] 0 0 0 0 
Elementary Row Operations In Exercises 7-10, 20. [9 1 0 l 
identify the elementary row operation(s) being performed 1 0 2 1 
to obtain the new row-equivalent matrix. —2 1 5 
Original Matrix New Row-Equivalent Matrix 21. 0 =1 2 1 
i E 5 | E 0 2) 0 0 2 
f 3 -1 -8 3 =l =8 1 0 2 1 
Original Matrix New Row-Equivalent Matrix 22. | 0 1 3 4 
r [ 3 -1 z E -1 E oo 1 0 
“1-4 3 7 5 0 -5 0 0 1 0 0 
Original Matrix New Row-Equivalent Matrix 23. |0 0 0 1 0 
tst =) 9) [=r 5 48 7 oo 0 2 Q 
9%. |-1 5 -8 7 0 -1 -7 7 1 0 O0 0 
3 -2 1 2 0 13-23 23 a O 0 1 
= , , ; 0 0 0 0 
Original Matrix New Row-Equivalent Matrix 
=] =2 3 =2 =i _=2 3 =2 System of Linear Equations In Exercises 25-38, 
10. 2 =5 1 =7 0 =9 7-11 solve the system using either Gaussian elimination with 
5 4 -7 6 0 -6 8 —4 back-substitution or Gauss-Jordan elimination. 
, , 25. x+3y= 11 26. 2x+6y= 16 
Augmented Matrix In Exercises 11-18, find the 3x + y= 9 -2x — 6y = — 16 


solution set of the system of linear equations represented 


by the augmented matrix. 27. —x + 2y = 1.5 


2x — 4y =3 


1 0 0 1 0 2 
1 -1 0 3 i 2 1 0 ih i 
B./0 1 -2 1) mlo o 1 -1 29. —3x + 5y = -22 
0 0 1 -1 0 0 0 0 Sa A 
> 1 3 a ae ee SE da 
15.1 -1 tf ol 1.1 2 «2 0 30. x+2y=0 
0 1 2 1 10 ı 2 aS 28 
3x — 2y = 8 
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31. 


32. 


33. 


34. 


35. 


36. 


37. 


38. 


acd System of Linear Equations In Exercises 39—42, use 
(=) 2 software program or a graphing utility to solve the 


x, = 3x, = -2 
3X, + %—2x%,= 5 
2X, + 2%, + x, = 4 
3x, — 2x, + 3x, = 22 
3X, — x, = 24 
6x, — 7x, = —22 
2X, F 3x, = 3 
4x, = 3x, + 7x, = 5 
8x, — 9x, + 15x, = 10 
Xx, + x, — 5x, = 3 
x = 2x, = 1 
2X, —%, —- x, =0 
4x + 12y — 7z — 20w = 22 
3x + 9y — 5z — 28w = 30 
x+2y+ z= 8 
3x = 6y — 3z = —-21 
3x + 3y + 122 = 6 
x+ y+ &= 2 
2x + 5y + 20z = 10 
—x+2y+ 8z= 4 
2x+ y~ z+2w=-—6 
3x + 4y + w= 1 
x + 5y + 2z + 6w = -3 
Sx+2y- z- w= 3 


= system of linear equations. 


39, 


40. 


41. 


42. 


Xi — 2x, + 5x3 = 3x4 = 23.6 

Xx, + 4x, — Tx, — 2x, = 45.7 
3x, — 5x, + Tx, + 4x, = 29.9 

X, + xX, — 2x, + 3x, + 2x, = 9 
3X, t 3x3 — at ay age 
2X; + 2%, — Xs X= 2x5 = 1 
4x, + 4x, + Xx, = 3x5 =4 
8x, + 5x, — 2x, = x4 + 2x5 = 3 
x= X) + 2x, +2x,+ 6x,= 6 
3x, — 2x, + 4x, + 4x, + 12x, = 14 
X> X3 X4 3x; = —3 

2x, — 2x, + 4x, + 5x, + 15x; = 10 
2x, — 2x, + 4x, + 4x4 + 13x, = 13 

Xi + 2x, = 2x, + 2x, = Xs + 3x— = 
2X, — Xy + 3x, + y = 3x5 + 2x6 = 

%, + 3x5 — 2x3 i — 2X5 — 3G 
3X, ay X= y Sx, = Dk = 


Hy ON a 2% Dt 3X, 
X, = 3h xe Bxy 2st XE 


1.2 Exercises 23 


Homogeneous System In Exercises 43-46, solve the 
homogeneous linear system corresponding to the given 
coefficient matrix. 


1 0 0 
wo i if a(t © 9 9 
0 0 0 
1 0 0 1 0 0 0 
45. | 0 0 1 0 46. | 0 0 0 
0 0 0 0 0 0 0 


47. Finance A small software corporation borrowed 
$500,000 to expand its software line. The corporation 
borrowed some of the money at 3%, some at 4%, and 
some at 5%. Use a system of equations to determine 
how much was borrowed at each rate when the annual 
interest was $20,500 and the amount borrowed at 4% 
was 2} times the amount borrowed at 3%. Solve the 
system using matrices. 


48. Tips A food server examines the amount of money 
earned in tips after working an 8-hour shift. The server 
has a total of $95 in denominations of $1, $5, $10, 
and $20 bills. The total number of paper bills is 26. 
The number of $5 bills is 4 times the number of $10 
bills, and the number of $1 bills is 1 less than twice the 
number of $5 bills. Write a system of linear equations 
to represent the situation. Then use matrices to find the 
number of each denomination. 


Matrix Representation In Exercises 49 and 50, assume 
that the matrix is the augmented matrix of a system 
of linear equations, and (a) determine the number of 
equations and the number of variables, and (b) find the 
value(s) of k such that the system is consistent. Then 
assume that the matrix is the coefficient matrix of a 
homogeneous system of linear equations, and repeat 
parts (a) and (b). 


wafi Ey 


=3 4 1 

2 =1 3 

50. A=|—4 2 k 
4 -2 6 


Coefficient Design In Exercises 51 and 52, find values 
of a, b, and c (if possible) such that the system of linear 
equations has (a) a unique solution, (b) no solution, and 
(c) infinitely many solutions. 


5L. x+ y =2 52. x+ y =0 
y+ z=2 y+ z=0 
x + z=2 x + z=0 


ax + by + cz =0 ax + by + cz =0 
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53. The system below has one solution: x = 1, y = —1, 
and z = 2. 
4x — 2y + 5z = 16 Equation 1 
x+ y = 0 Equation 2 
=x = 3y+2z= 6 Equation 3 


Solve the systems provided by (a) Equations 1 and 2, 
(b) Equations 1 and 3, and (c) Equations 2 and 3. 
(d) How many solutions does each of these systems 


have? 
54. Assume the system below has a unique solution. 
Ay 4X1 + aX + A,3x3 = bı Equation 1 
An 1X1 + aX, + Ay3X3 = bz Equation 2 
A3,X1 + a32X3 + a33X3 = b3 Equation 3 


Does the system composed of Equations 1 and 2 have 
a unique solution, no solution, or infinitely many 
solutions? 


Row Equivalence In Exercises 55 and 56, find the 
reduced row-echelon matrix that is row-equivalent to 
the given matrix. 


1 2 3 
55. | z| 56. |4 5 6 
7 8 9 


57. Writing Describe all possible 2x2 reduced 
row-echelon matrices. Support your answer with 
examples. 


58. Writing Describe all possible 3x3 reduced 
row-echelon matrices. Support your answer with 
examples. 


True or False? In Exercises 59 and 60, determine 
whether each statement is true or false. If a statement 
is true, give a reason or cite an appropriate statement 
from the text. If a statement is false, provide an example 
that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


59. (a) A 6 x 3 matrix has six rows. 


(b) Every matrix is row-equivalent to a matrix in 
row-echelon form. 


(c) If the row-echelon form of the augmented matrix 
of a system of linear equations contains the row 
[1 0 0 0 O], then the original system is inconsistent. 


(d) A homogeneous system of four linear equations in 
six variables has infinitely many solutions. 


60. (a) A 4 x 7 matrix has four columns. 
(b) Every matrix has a unique reduced row-echelon form. 


(c) A homogeneous system of four linear equations in 
four variables is always consistent. 


(d) Multiplying a row of a matrix by a constant is one 
of the elementary row operations. 


61. Writing Is it possible for a system of linear equations 
with fewer equations than variables to have no solution? 
If so, give an example. 

62. Writing Does a matrix have a unique row-echelon 
form? Illustrate your answer with examples. 


Row Equivalence In Exercises 63 and 64, determine 
conditions on a, b, c, and d such that the matrix 


[e a 
c d 
will be row-equivalent to the given matrix. 

1 0 1 0 
63. | 0 | 64. | 0 ol 
Homogeneous System In Exercises 65 and 66, find 
all values of A (the Greek letter lambda) for which the 
homogeneous linear system has nontrivial solutions. 
65. (A — 2)x + y=0 

x+(Q—-2)y=0 


66. (2A + 9)x — 5y = 0 
x—-dAy=0 


67. The augmented matrix represents a system of linear 
equations that has been reduced using Gauss-Jordan 
elimination. Write a system of equations with nonzero 
coefficients that the reduced matrix could represent. 


1 0 3, =2 
0 1 4 1 
0 0 0 0 


There are many correct answers. 


68. CAPSTONE In your own words, describe the 
difference between a matrix in row-echelon form 


and a matrix in reduced row-echelon form. Include 
an example of each to support your explanation. 


69. Writing Consider the 2 x 2 matrix f a 
c 
Perform the sequence of row operations. 


(a) Add (— 1) times the second row to the first row. 
(b) Add 1 times the first row to the second row. 

(c) Add (— 1) times the second row to the first row. 
(d) Multiply the first row by (— 1). 


What happened to the original matrix? Describe, in 
general, how to interchange two rows of a matrix using 
only the second and third elementary row operations. 


70. Writing Describe the row-echelon form of an 
augmented matrix that corresponds to a linear system 
that (a) is inconsistent, and (b) has infinitely many 


solutions. 


D 
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1.3 Applications of Systems of Linear Equations 


n Yn) 


(x3, y3) 


2, y2) 


> xX 


(x1, y1) 


Polynomial Curve Fitting 


Figure 1.3 


Figure 1.4 


Set up and solve a system of equations to fit a polynomial function 
to a set of data points. 


il Set up and solve a system of equations to represent a network. 


Systems of linear equations arise in a wide variety of applications. In this section you 
will look at two applications, and you will see more in subsequent chapters. The first 
application shows how to fit a polynomial function to a set of data points in the plane. 
The second application focuses on networks and Kirchhoff’s Laws for electricity. 


POLYNOMIAL CURVE FITTING 


Consider n points in the xy-plane 


(x; yi) (x, Vols oe eg (x, Ya) 


that represent a collection of data, and you want to find a polynomial function of degree 
n=] 


p(x) = a + ax + a,x? +> > o + a, x"! 


whose graph passes through the points. This procedure is called polynomial curve fitting. 
When all x-coordinates of the points are distinct, there is precisely one polynomial function 
of degree n — 1 (or less) that fits the n points, as shown in Figure 1.3. 

To solve for the n coefficients of p(x), substitute each of the n points into the 
polynomial function and obtain n linear equations in n variables ag, a), d>,. . ., A,—1- 


2 E n=l — 
Ag t ax; + a xf + + a,—1%1 yy 


2 ni n-1l — 
Ag + aX) + axy + nE. 1X3 Y2 


n-1l — 


dg + aX, +axr+---ta, l Ey 


Example 1 demonstrates this procedure with a second-degree polynomial. 


EXAMPLE 1 Polynomial Curve Fitting 


Determine the polynomial p(x) = ay + a,x + a,x? whose graph passes through the 

points (1, 4), (2, 0), and (3, 12). 

SOLUTION 

Substituting x = 1, 2, and 3 into p(x) and equating the results to the respective y-values 

produces the system of linear equations in the variables do, a,, and a, shown below. 
p(l) = ay + a,(1) + a,(1)? 
P(2) = dy + a,(2) + a,(2) 
p(3) = ay + a,(3) + (3)? 


=a + a+ a= 4 
= ad) + 2a, + 4a,= 0 
dy + 3a, + 9a, = 12 


The solution of this system is 
dy = 24, a, = —28, anda, = 8 
so the polynomial function is 
p(x) = 24 — 28x + 8x. 


Figure 1.4 shows the graph of p. | 
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EXAMPLE 2 Polynomial Curve Fitting 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


Find a polynomial that fits the points 
(—2, 3), (—1, 5), (0, 1), (1, 4), and (2, 10). 
SOLUTION 


You are given five points, so choose a fourth-degree polynomial function 
P(x) = dy + ax + ax? + aye + a,x’. 


Substituting the points into p(x) produces the system of linear equations shown below. 


>< 


ay — 2a, + 4a, — 8a, + 16a, = 3 
(2, 10) a- at a- at a= 5 
do = 1 
at at at at a= 4 
dy + 2a, + 4a, + 8a, + 16a, = 10 


The solution of these equations is 


=| ee) — 101 _3 = oh 
ag > 4 p h 24> 43 ~ 4 4 ~ “24 


which means the polynomial function is 


S p(x) = 1 - $y 4 te + 33 — ie. 
Figure 1.5 Figure 1.5 shows the graph of p. m 


The system of linear equations in Example 2 is relatively easy to solve because 
the x-values are small. For a set of points with large x-values, it is usually best to 
translate the values before attempting the curve-fitting procedure. The next example 
demonstrates this approach. 


EX AMPLE 3 Translating Large x-Values Before Curve Fitting 


Find a polynomial that fits the points 


@ 91) a y2) (x3, y3) (X4, Y4) (%5, ys) 
Pg pR pe Sy SX 
(2011, 3), (2012, 5), (2013, 1), (2014, 4), (2015, 10). 

SOLUTION 

The given x-values are large, so use the translation 
z = x — 2013 

to obtain 

(21,91) (25, y2) (23, y3) (24, Ya) (zs; y5) 

(-2,3), L @©D, 4, (210): 


This is the same set of points as in Example 2. So, the polynomial that fits these points is 
p@) =1-i2t yet @ — ue 
Letting z = x — 2013, you have 


p(x) = 1 — Ž(x — 2013) + Bx — 2013)? + 3x — 2013} — E(x — 2013)4. 
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EXAMPLE 4 An Application of Curve Fitting 


Find a polynomial that relates the periods of the three planets that are closest to the Sun 
to their mean distances from the Sun, as shown in the table. Then use the polynomial to 
calculate the period of Mars, and compare it to the value shown in the table. (The mean 
distances are in astronomical units, and the periods are in years.) 


Planet Mercury Venus Earth Mars 


0.387 0.723 1.000 1.524 
0.241 0.615 1.000 1.881 


Mean Distance 


Period 


SOLUTION 
Begin by fitting a quadratic polynomial function 
P(x) = dy + ax + a,x? 
to the points 
(0.387, 0.241), (0.723, 0.615), and (1, 1). 
The system of linear equations obtained by substituting these points into p(x) is 


dy + 0.387a, + (0.387)}a, = 0.241 
dy + 0.723a, + (0.723)?a, = 0.615 
ag + a, + a, = 1. 


The approximate solution of the system is 
dy = —0.0634, a, ~ 0.6119, a, ~ 0.4515 

which means that an approximation of the polynomial function is 
p(x) = — 0.0634 + 0.6119x + 0.4515x?. 

Using p(x) to evaluate the period of Mars produces 
p(1.524) = 1.918 years. 


Note that the period of Mars is shown in the table as 1.881 years. The figure below 


provides a graphical comparison of the polynomial function to the values shown in the 
table. 


y 
A 


2.0 7 (1.524, 1.881) 


Period (in years) 
> 


Mercury (0.387, 0.241) 
} } } >r 
0.5 10 15 20 
Mean distance from the Sun 
(in astronomical units) | 
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As illustrated in Example 4, a polynomial that fits some of the points in a data 
set is not necessarily an accurate model for other points in the data set. Generally, the 
farther the other points are from those used to fit the polynomial, the worse the fit. For 
instance, the mean distance of Jupiter from the Sun is 5.203 astronomical units. Using 
p(x) in Example 4 to approximate the period gives 15.343 years—a poor estimate of 
Jupiter’s actual period of 11.862 years. 

The problem of curve fitting can be difficult. Types of functions other than 
polynomial functions may provide better fits. For instance, look again at the curve-fitting 
problem in Example 4. Taking the natural logarithms of the distances and periods 
produces the results shown in the table. 


Planet Mercury Venus Earth Mars 


0.387 0.723 1.000 1.524 


Mean Distance, x 


In x —0.949  —0.324 0.0 0.421 
Period, y 0.241 0.615 1.000 1.881 
In y — 1.423 —0.486 0.0 0.632 


Now, fitting a polynomial to the logarithms of the distances and periods produces the 
linear relationship 


Iny =3Inx 


which is shown graphically below. 


ln y 


From In y = 31n x, it follows that y = x3”, or y? = x3. In other words, the square of the 
period (in years) of each planet is equal to the cube of its mean distance (in astronomical 
units) from the Sun. Johannes Kepler first discovered this relationship in 1619. 


LINEAR Researchers in Italy studying the acoustical noise levels 
ALGEBRA from vehicular traffic at a busy three-way intersection used 
APPLIED a system of linear equations to model the traffic flow at the 


intersection. To help formulate the system of equations, 
“operators” stationed themselves at various locations 
along the intersection and counted the numbers of vehicles 
that passed them. (Source: Acoustical Noise Analysis in Road 
Intersections: A Case Study, Guarnaccia, Claudio, Recent Advances 
in Acoustics & Music, Proceedings of the 11th WSEAS International 
Conference on Acoustics & Music: Theory & Applications) 
iStockphoto.com/Nikada 
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Figure 1.6 
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NETWORK ANALYSIS 


Networks composed of branches and junctions are used as models in such fields 
as economics, traffic analysis, and electrical engineering. In a network model, you 
assume that the total flow into a junction is equal to the total flow out of the junction. 
For example, the junction shown below has 25 units flowing into it, so there must be 
25 units flowing out of it. You can represent this with the linear equation 


x, + x, = 25. 


X2 


Each junction in a network gives rise to a linear equation, so you can analyze the 
flow through a network composed of several junctions by solving a system of linear 
equations. Example 5 illustrates this procedure. 


EXAMPLE 5 Analysis of a Network 


Set up a system of linear equations to represent the network shown in Figure 1.6. Then 
solve the system. 


SOLUTION 


Each of the network’s five junctions gives rise to a linear equation, as shown below. 


x, + X, = 20 Junction 1 
X3 — X4 = —20 Junction 2 

X + X3 = 20 Junction 3 

xy xX, = 10 Junction 4 
— 44 +%, = —10 Junction 5 


The augmented matrix for this system is 


0 0 0 20 
1 -1 0 —20 
1 0 O 20}. 
0 0. =1 =10 
0 0 =l 1 —10 


O = O O m 
O = O = 


Gauss-Jordan elimination produces the matrix 


1 (0) 0 0 —1 -10 
(0) 1 (0) (0) 1 30 
(0) (0) 1 0 —1 -10 
(0) (0) (0) 1 —1 10 
0 (0) (0) (0) (0) 0 
From the matrix above, 
x, — 4X, = —10, x5 + x, = 30, a,-45= —-10, and x, — 2x, = 10. 


Letting t = x5, you have 
x, =t-10, x, = =t+ 30, x, =1-10, x, =t+10, x= t 


where ż is any real number, so this system has infinitely many solutions. | 
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REMARK 


A closed path is a sequence 
of branches such that the 
beginning point of the first 
branch coincides with the 


ending point of the last branch. 


R,=4Q 8V 


Figure 1.7 


In Example 5, if you could control the 
amount of flow along the branch labeled x5, then 
you could also control the flow represented by 
each of the other variables. For example, letting 
t = 10 results in the flows shown in the figure 
at the right. (Verify this.) 


You may be able to see how the type of network analysis demonstrated in Example 5 
could be used in problems dealing with the flow of traffic through the streets of a city 
or the flow of water through an irrigation system. 

An electrical network is another type of network where analysis is commonly 
applied. An analysis of such a system uses two properties of electrical networks known 
as Kirchhoff’s Laws. 


1. All the current flowing into a junction must flow out of it. 


2. The sum of the products /R (/ is current and R is resistance) around a closed path 
is equal to the total voltage in the path. 


In an electrical network, current is measured in amperes, or amps (A), resistance is 
measured in ohms (Q, the Greek letter omega), and the product of current and 
resistance is measured in volts (V). The symbol — | represents a battery. The 
larger vertical bar denotes where the current flows out of the terminal. The symbol 
VVV denotes resistance. An arrow in the branch shows the direction of the current. 


EXAMPLE 6 Analysis of an Electrical Network 


Determine the currents /,, /,, and J, for the electrical network shown in Figure 1.7. 


SOLUTION 
Applying Kirchhoff’s first law to either junction produces 


L+h=L Junction 1 or Junction 2 
and applying Kirchhoff’s second law to the two paths produces 


Ril, + Roly = 31, + 21, =7 Path | 
Ry, + Ral; = 2, + 41, = 8. Path 2 


So, you have the system of three linear equations in the variables /,, /,, and Z4 shown 
below. 


L- L+ L=0 
31, + 2L =i 
21, + AI, = 8 


Applying Gauss-Jordan elimination to the augmented matrix 


] =] 1 0 


which means J, = 1 amp, J, = 2 amps, and J, = 1 amp. | 
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EXAMPLE 7 Analysis of an Electrical Network 


Determine the currents J,, Z, B, 4, 15, and J, for the electrical network shown below. 


17V  R,=2Q 


10 V, 14V 


I; 
SOLUTION 
Applying Kirchhoff’s first law to the four junctions produces 
Lt+h=L Junction 1 
LtL,=L Junction 2 
+h =T, Junction 3 
+k =, Junction 4 


and applying Kirchhoff’s second law to the three paths produces 


21, + 41, = 10 Path 1 
4i, + I, + 2, + 2s =17 Path 2 
21; + 4l = 14. Path 3 


You now have the system of seven linear equations in the variables /,, Z, Z, 14, [,, and 
I shown below. 


h= hth 0 
I, lL, + L = 0 
I, = de I= 0 
L= I I= 0 
21, + 4, = 10 
41, + I, + 21, + 21, =17 
21, + 41, = 14 
The augmented matrix for this system is 
1 —-l 1 0 0 0 0 
1 -1 (0) 1 0 0 0 
0 0 1 0 -lI 1 (0) 
0 0 0 1 -1 1 QO}. 
2 4 (0) 0 0 QO 10 
(0) 4 1 2 2 0 17 
0 0 0 0 2 4 14 


Using a graphing utility, a software program, or Gauss-Jordan elimination, solve this 
system to obtain 


L=1, L=2, L=1, =i, =3, and Las, 


So, J; = 1 amp, J, = 2 amps, I, = 1 amp, J, = 1 amp, I; = 3 amps, and J, = 2 amps. 
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Chapter 1 


Systems of Linear Equations 


1 3 Exercises See CalcChat.com for worked-out solutions to odd-numbered exercises. 


Polynomial Curve Fitting In Exercises 1-12, (a) determine 
the polynomial function whose graph passes through 
the points, and (b) sketch the graph of the polynomial 
function, showing the points. 


1. (2, 5), (3, 2), (4, 5) 


2. (0, 0), (2, — 2), (4, 0) 
3. (2, 4), (3, 6), (5, 10) 
4. (2, 4), (3, 4), (4, 4) 
5. (— 1, 3), (0, 0), (1, 1), (4, 58) 
6. (0, 42), (1, 0), (2, — 40), (3, — 72) 
7. (—2, 28), (— 1, 0), (0, — 6), (1, — 8), (2, 0) 
8. (—4, 18), (0, 1), (4, 0), (6, 28), (8, 135) 
9. (2013, 5), (2014, 7), (2015, 12) 
10. (2012, 150), (2013, 180), (2014, 240), (2015, 360) 
11. (0.072, 0.203), (0.120, 0.238), (0.148, 0.284) © 20. 
12. (1, 1), (1.189, 1.587), (1.316, 2.080), (1.414, 2.520) . 
13. Use sin0 = 0, sin 5 = ], and sinz = 0 to estimate 
n 
sin z. 


14. Use log, 1 = 0, log, 2 = 1, and log, 4 = 2 to estimate 


log, 3. 


Equation of a Circle In Exercises 15 and 16, find an 
equation of the circle that passes through the points. 


15. (1, 3), (—2, 6), (4, 2) 
16. (—5, 1), (=3, 2), (—1, 1) 


17. Population The U.S. census lists the population of 
the United States as 249 million in 1990, 282 million 
in 2000, and 309 million in 2010. Fit a second-degree 
polynomial passing through these three points and use 
it to predict the populations in 2020 and 2030. (Source: 
U.S. Census Bureau) 


. Population The table shows the U.S. populations 
for the years 1970, 1980, 1990, and 2000. (Source: U.S. 
Census Bureau) 


Year 1970 1980 1990 2000 


Population 


(in millions) D 


227 249 282 


(a) Find a cubic polynomial that fits the data and use it 
to estimate the population in 2010. 

(b) The actual population in 2010 was 309 million. 
How does your estimate compare? 


(x) 19. 


2L 


i ee [E], 


Net Profit The table shows the net profits (in 
millions of dollars) for Microsoft from 2007 through 


2014. (Source: Microsoft Corp.) 
Year 2007 2008 2009 2010 
Net Profit | 14,065 17,681 14,569 18,760 
Year 2011 2012 2013 2014 
Net Profit | 23,150 23,171 22,453 22,074 


(a) Set up a system of equations to fit the data for the 
years 2007, 2008, 2009, and 2010 to a cubic model. 

(b) Solve the system. Does the solution produce a 
reasonable model for determining net profits after 
2010? Explain. 

Sales The table shows the sales (in billions of 

dollars) for Wal-Mart stores from 2006 through 


2013. (Source: Wal-Mart Stores, Inc.) 
Year | 2006 2007 2008 2009 
Sales | 348.7 378.8 405.6 408.2 
Year | 2010 2011 2012 2013 
Sales | 421.8 447.0 469.2 476.2 


(a) Set up a system of equations to fit the data for the 
years 2006, 2007, 2008, 2009, and 2010 to a quartic 
model. 

(b) Solve the system. Does the solution produce a 
reasonable model for determining sales after 2010? 
Explain. 

Network Analysis The figure shows the flow of traffic 

(in vehicles per hour) through a network of streets. 


x} 


400 600 


(a) Solve this system for x, i = 1,2,. . .,5. 
(b) Find the traffic flow when x, = 0 and x; = 100. 
(c) Find the traffic flow when x, = x; = 100. 
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22. Network Analysis The figure shows the flow of traffic 
(in vehicles per hour) through a network of streets. 


X1 


300 —> 


X2 X4 


200 — 


> 
x5 


(a) Solve this system for x, i = 1,2,...,5. 
(b) Find the traffic flow when x, = 200 and x, = 50. 
(c) Find the traffic flow when x, = 150 and x, = 0. 


23. Network Analysis The figure shows the flow of traffic 
(in vehicles per hour) through a network of streets. 


200 
Xi xX 
100 100 
X3 Xa 
200 
(a) Solve this system for x, i = 1, 2, 3, 4. 


(b) Find the traffic flow when x, = 0. 
(c) Find the traffic flow when x, = 100. 
(d) Find the traffic flow when x, = 2x,. 


24. Network Analysis Water is flowing through a 
network of pipes (in thousands of cubic meters per 
hour), as shown in the figure. 


xı x2 
600 — — }>—( > 500 
X3 X4 X5 
600 —~< ~ < <— 500 
tg Y, 
(a) Solve this system for the water flow represented by 
x,i=1,2,...,7. 
(b) Find the water flow when x, = x, = 100. 


(c) Find the water flow when x, = x, = 0. 


(d) Find the water flow when x; = 1000 and x, = 0. 


1.3 Exercises 33 


25. Network Analysis Determine the currents /,, /,, and 
I, for the electrical network shown in the figure. 


I 3V 


R,=12 4V 


26. Network Analysis Determine the currents /,, h, 1, 
I,, I;, and I, for the electrical network shown in the 
figure. 


25 V 


Ry=2Q 


Re = 12 8V 
27. Network Analysis 


(a) Determine the currents J,, J,, and J, for the 
electrical network shown in the figure. 


(b) How is the result affected when A is changed to 
2 volts and B is changed to 6 volts? 


A A:5V 


B:8 V 
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28. CAPSTONE 


(a) Explain how to use systems of linear equations for 
polynomial curve fitting. 


b) Explain how to use systems of linear equations to 
p y q 
perform network analysis. 


Temperature In Exercises 29 and 30, the figure shows 
the boundary temperatures (in degrees Celsius) of an 
insulated thin metal plate. The steady-state temperature 
at an interior junction is approximately equal to the mean 
of the temperatures at the four surrounding junctions. 
Use a system of linear equations to approximate the 
interior temperatures T,, T,, T3, and T} 


29. 


© 


609, 


O 
uw 
So 

Q 


C) 
© 


O 
PÀ 
© 

o 


30. X lan 
0} — £0) 


6 
YY 


0) 
@ 


O 
N 
nn 

° 


ORO 


Partial Fraction Decomposition In Exercises 31-34, 
use a system of equations to find the partial fraction 
decomposition of the rational expression. Solve the 
system using matrices. 


4x? A B C 


š t + 
Meh) -l ee Gee 
24, — 
oe eae A 2 Cc 
(x+4)(x-4) x+4 x-4 (- 4) 
3x? — 3x — 2 A B C 


33 


‘QFD x+2 x-2 Go 


20 — x? _ A i B as C 
(x +2 (x-2? x+2 x-2 (x- 2) 


34 


Calculus In Exercises 35 and 36, find the values of x, y, 
and J that satisfy the system of equations. Such systems 
arise in certain problems of calculus, and J is called the 
Lagrange multiplier. 


35. 2x +À =0 

2y +4 =0 

AP y —-4=0 

36. Q2y+2A+ 25 
2x + A+ 15 
2x+ y — 100 = 0 


37. Calculus The graph of a parabola passes through 
the points (0, 1) and (4, 4) and has a horizontal tangent 


line at (£, 1), Find an equation for the parabola and 
sketch its graph. 


38. Calculus The graph of a cubic polynomial function 
has horizontal tangent lines at (1, — 2) and (— 1, 2). Find 
an equation for the function and sketch its graph. 


39. Guided Proof Prove that if a polynomial function 
p(x) = dy + a,x + ax? is zero for x = —1, x = 0, and 
x = 1, then a = a, =a, = 0. 
Getting Started: Write a system of linear equations and 
solve the system for dp, a,, and a. 
(i) Substitute x = — 1, 0, and 1 into p(x). 
(ii) Set each result equal to 0. 


(iii) Solve the resulting system of linear equations in 
the variables do, a,, and a. 


40. Proof Generalizing the statement in Exercise 39, if a 
polynomial function 


D(x) = ao + a,x +... + dy! 
is zero for more than n — 1 x-values, then 


0. 


ay ~ a, 77 a,-| 


Use this result to prove that there is at most one 
polynomial function of degree n — 1 (or less) whose 
graph passes through n points in the plane with distinct 
x-coordinates. 


41. (a) The graph of a function f passes through the points 
(0, 1), (2, ), and (4, 1). Find a quadratic function 
whose graph passes through these points. 


(b) Find a polynomial function p of degree 2 or less that 
passes through the points (0, 1), (2, 3), and (4, 5). 
Then sketch the graph of y = 1/p(x) and compare 
this graph with the graph of the polynomial function 
found in part (a). 
42. Writing Try to find a polynomial to fit the data shown 
in the table. What happens, and why? 
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1 Review Exercises 


Linear Equations In Exercises 1-6, determine whether 
the equation is linear in the variables x and y. 


1. 2x-y=4 2. 2xy — 6y = 0 

3. (cot 5)x =y = 3 4. e 2x + Sy =8 
2 x y 

. 2+ 4y = .2-2= 
5. + 4y =3 65270 


Parametric Representation In Exercises 7 and 8, find 
a parametric representation of the solution set of the 
linear equation. 

7. —3x + 4y = 2z= 1 8. 3x, + 2x, — 4x, = 0 
System of Linear Equations In Exercises 9-20, solve 
the system of linear equations. 


9 xty=2 10. x+ y=-l1 
3x -y=0 3x + 2y= 0 
11. 3y = 2x 12, x=y+ 3 
y= x+4 4x =y + 10 
13. y+x=0 14. y= 5x 
2x+y=0 y= -x 
15. x-y=9 16. 40x, + 30x, = 24 
-xty=1 20x, + 15x, = —14 
17. ly — by = 0 18. t+ y= 3 


3x + 2(y + 5) = 10 
19. 0.2x, + 0.3x, = 0.14 
0.4x, + 0.5x, = 0.20 


20. 0.2x — O.ly = 0.07 
0.4x — 0.5y = —0.01 


2x + 3y = 15 


Matrix Size In Exercises 21 and 22, determine the size 
of the matrix. 


2 1 
21. f “|| yaa. =Í 
0 5 


Augmented Matrix In Exercises 23-26, find the 
solution set of the system of linear equations represented 
by the augmented matrix. 


1 2 =5 =2 3 0 
23. E 1 d 24. | 0 o0 ol 
1 2 0 0 
25. | 0 0 1 0 
0 0 0 0 
1 2 3 0 
26 |0 0 0 1 
0 0 0 0 


See CalcChat.com for worked-out solutions to odd-numbered exercises. 


(=) 40. 


Review Exercises 35 
[m] 
| Ch 


Row-Echelon Form In Exercises 27-30, determine 
whether the matrix is in row-echelon form. If it is, 
determine whether it is also in reduced row-echelon 
form. 


1 2 =3 1 0 1 1 

27. | 0 0 0 1 28. | 0 1 2 1 
0 0 0 0 0 0 1 

= 2 1 0 1 0 0 

29 0 1 30. | 0 0 1 2 
0 0 1 0 0 0 0 


System of Linear Equations In Exercises 31-40, 
solve the system using either Gaussian elimination with 
back-substitution or Gauss-Jordan elimination. 
31. -x+ yt+2z= 1 
2x+3y+ z= -2 
5xt+4y+2z= 4 
32. 4x + 2y+ z= 
4x — 2y — 2z 
2x — 3y + 2z = -8 
33. 2x+3y+ 3z= 3 
6x + 6y + 12z = 13 


| 
N Re 
oOo o0 


12x+9y- z= 2 
34. 2x + yt2z=4 
2x + 2y = 
2x- yto6z= 
35. x—2y+ z=-6 
2x — 3y =7 
—x + 3y — 3z = 11 
36. 2x + 6z= =9 


3x — 2y + llz = -16 
3x- y+ %z= -11 
37. x+2y+ 6z= 1 
2x + 5y + 15z= 4 
3x + y+ 3z= -6 
38. 2x, + 5x, — 19x, = 34 
3x, + 8x, — 31x, = 54 


2X, + X, + xX, + 2x,=-1 
5x, — 2X, + x, — 3x, = 
=x, + 3x, + 2x, + 2x,= 1 
3x, + 2x, + 3x, — 5x, = 12 
xi + 5x, + 3x5 = 14 
4x, + 2x, + 5x, = 3 
3x, + 8x, + 6x; = 16 
2x, + 4x, —2x,= 0 


2X = hy = 0 
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Ae System of Linear Equations In Exercises 41-46, use 


a software program or a graphing utility to solve the 
system of linear equations. 
41. x, + x, + x = 154 
x, = ġa — 2x3 = 27.9 
3x, — 2x, + x, = 76.9 
42. 1.1x, + 2.3x, + 3.4x, = 0 
11x; = 2.2x, = 4.4%, = 0 
—1.7x, + 3.4x, + 6.8x, = 1 
43. 3x + 3y + 12z= 6 
x+ yt 4z= 2 
2x + 5y + 20z = 10 
—x+2y+ 8z= 4 
44.x+ 2y+z+ 3w=0 
x- y + w=0 
Sy —z+2w =0 
45. 2x+ 10y+2z= 6 
x+ Sy+2z= 6 
xt Sy+ z= 3 
—3x = I5y + 3z = =9 
46. 2x + y— z+2w=-6 
3x + 4y + w= 1 
x + 5y + 2z + 6w = -3 
5x+2y- z- w= 3 


Homogeneous System In Exercises 47-50, solve the 
homogeneous system of linear equations. 
47. x, — 2x, — 8x, = 0 
3x, + 2x5 =0 
48. 2x, + 4x, — 7x, = 0 
xX, — 3x, + 9x, =0 
49. —2x, + 7x, — 3x,=0 
4x, — 12x, + 5x, = 0 
12x, + 7x, = 0 
50. x, + 3x, + 5x, = 0 
x, + 4x, + ax, = 0 


51. Determine the values of k such that the system of linear 
equations is inconsistent. 
kx + y=0 
x+ky=1 
52. Determine the values of k such that the system of linear 
equations has exactly one solution. 
x= y+2z=0 
=x y= z= 0 
x+ky+ z=0 
53. Find values of a and b such that the system of linear 
equations has (a) no solution, (b) exactly one solution, 
and (c) infinitely many solutions. 
x+2y= 3 
ax + by = —9 


54. Find (if possible) values of a, b, and c such that the system 
of linear equations has (a) no solution, (b) exactly one 
solution, and (c) infinitely many solutions. 
2x- yt z=a 

x+ yt2z=b 
3y + 3z 
55. Writing Describe a method for showing that two 


matrices are row-equivalent. Are the two matrices 
below row-equivalent? 


Cc 


1 1 2 1 2 3 
0 -1 2| and |4 3 6 
3 1 2 5 5 10 


56. Writing Describe all possible 2 x 3 reduced row- 
echelon matrices. Support your answer with examples. 


57. Let n 2 3. Find the reduced row-echelon form of the 
n x n matrix. 


1 2 F aga n 
n+1 n+2 n+ 3 rea 2n 
2n + 1 2n + 2 2m. F3 mea 3n 

m—o—nt1 RĦR-n+2 RĦR-n+3 ... P 


58. Find all values of A for which the homogeneous system 
of linear equations has nontrivial solutions. 


A +2)x = 2x, + 3x, = 0 
—2x, + A — 1)x, + 6x, = 0 
x + 2x, + Ax; = 0 


True or False? In Exercises 59 and 60, determine 
whether each statement is true or false. If a statement 
is true, give a reason or cite an appropriate statement 
from the text. If a statement is false, provide an example 
that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


59. (a) There is only one way to parametrically represent 
the solution set of a linear equation. 
(b) A consistent system of linear equations can have 
infinitely many solutions. 


60. (a) A homogeneous system of linear equations must 
have at least one solution. 
(b) A system of linear equations with fewer equations 
than variables always has at least one solution. 


61. Sports In Super Bowl I, on January 15, 1967, the 
Green Bay Packers defeated the Kansas City Chiefs by 
a score of 35 to 10. The total points scored came from a 
combination of touchdowns, extra-point kicks, and field 
goals, worth 6, 1, and 3 points, respectively. The numbers 
of touchdowns and extra-point kicks were equal. There 
were six times as many touchdowns as field goals. Find 
the numbers of touchdowns, extra-point kicks, and field 
goals scored. (Source: National Football League) 
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62. Agriculture A mixture of 6 gallons of chemical A, 
8 gallons of chemical B, and 13 gallons of chemical C 
is required to kill a destructive crop insect. Commercial 
spray X contains 1, 2, and 2 parts, respectively, of these 
chemicals. Commercial spray Y contains only chemical C. 
Commercial spray Z contains chemicals A, B, and C in 
equal amounts. How much of each type of commercial 
spray is needed to get the desired mixture? 


Partial Fraction Decomposition In Exercises 63 and 
64, use a system of equations to find the partial fraction 
decomposition of the rational expression. Solve the 
system using matrices. 


8x? __A x B y C 
(x-1?a+1) x+1 x-1 =@w-1) 


63. 


3x2 + 3x- 2 A B C 


; = + 
erele xi ox ooN 


Polynomial Curve Fitting In Exercises 65 and 66, 
(a) determine the polynomial function whose graph 
passes through the points, and (b) sketch the graph of 
the polynomial function, showing the points. 


65. (2, 5), (3, 0), (4, 20) 
66. (— 1, — 1), (0, 0), (1, 1), (2, 4) 


67. Sales A company has sales (measured in millions) 
of $50, $60, and $75 during three consecutive years. 
Find a quadratic function that fits the data, and use it to 
predict the sales during the fourth year. 


68. The polynomial function 
P(X) = ag + a,x + a,x? + a,x? 
is zero when x = 1, 2, 3, and 4. What are the values of 
ap 41, Ay, and a}? 


69. Deer Population A wildlife management team 
studied the population of deer in one small tract of a 
wildlife preserve. The table shows the population and 
the number of years since the study began. 


0 4 80 
80 68 30 


Year 


Population 


(a) Set up a system of equations to fit the data to a 
quadratic function. 


(b) Solve the system. 


fp (c) Use a graphing utility to fit the data to a quadratic 
model. 
(d) Compare the quadratic function in part (b) with the 
model in part (c). 
(e) Cite the statement from the text that verifies your 
results. 


Review Exercises 37 


70. Vertical Motion An object moving vertically is 
at the given heights at the specified times. Find the 
position equation 
s= Sat? + vot + So 
for the object. 

(a) At t = 0 seconds, s = 160 feet 
Att = 1 second, s = 96 feet 
At t = 2 seconds, s = 0 feet 

(b) Att = 1 second, s = 134 feet 
At t = 2 seconds, s = 86 feet 
At t = 3 seconds, s = 6 feet 

(c) Att = 1 second, s = 184 feet 
At t = 2 seconds, s = 116 feet 
At t = 3 seconds, s = 16 feet 


71. Network Analysis The figure shows the flow 
through a network. 


(a) Solve the system for x, i = 1,2,...,6. 
(b) Find the flow when x, = 100, x, = 50, and 
x = 50. 
300 


200 —> 


100 


72. Network Analysis Determine the currents /,, /,, and 
L for the electrical network shown in the figure. 


A 3V 
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1 Graphing Linear Equations 


You saw in Section 1.1 that you can represent a system of two linear equations 
in two variables x and y geometrically as two lines in the plane. These lines can 
intersect at a point, coincide, or be parallel, as shown in Figure 1.8. 


1. Consider the system below, where a and b are constants. 


26 yi — 3 
ax + by =6 


(a) Find values of a and b for which the resulting system has a unique solution. 


(b) Find values of a and b for which the resulting system has infinitely 
many solutions. 


(c) Find values of a and b for which the resulting system has no solution. 
(d) Graph the lines for each of the systems in parts (a), (b), and (c). 


2. Now consider a system of three linear equations in x, y, and z. Each equation 
represents a plane in the three-dimensional coordinate system. 


(a) Find an example of a system represented by three planes intersecting in 
a line, as shown in Figure 1.9(a). 


(b) Find an example of a system represented by three planes intersecting at 
a point, as shown in Figure 1.9(b). 


(c) Find an example of a system represented by three planes with no common 
intersection, as shown in Figure 1.9(c). 


(d) Are there other configurations of three planes in addition to those given in 
Figure 1.9? Explain. 


2 Underdetermined and Overdetermined Systems 


The system of linear equations below is underdetermined because there are more 
variables than equations. 


Si an Pay — Si 


Figure 1.8 
Pe iy ae CD es 3) 


Similarly, the system below is overdetermined because there are more equations 
than variables. 


i ae iy 8) 
iy = Dh Gy = 8) 
=r hea = © 


Explore whether the number of variables and the number of equations have any 
bearing on the consistency of a system of linear equations. For Exercises 1—4, if an 
answer is yes, give an example. Otherwise, explain why the answer is no. 


. Can you find a consistent overdetermined linear system? 


am 
a mel 1. Can you find a consistent underdetermined linear system? 
a 


. Can you find an inconsistent underdetermined linear system? 


. Can you find an inconsistent overdetermined linear system? 


nan bk U N 


. Explain why you would expect an overdetermined linear system to be inconsistent. 
Must this always be the case? 


6. Explain why you would expect an underdetermined linear system to have 
infinitely many solutions. Must this always be the case? 


2 Matrices 


2.1 Operations with Matrices 

2.2 Properties of Matrix Operations 

2.3 The Inverse of a Matrix 

2.4 Elementary Matrices 

2.5 Markov Chains 

2.6 More Applications of Matrix Operations 


S4 


Pe 


Computational Fluid Dynamics (p. 79) 


Information Retrieval (p. 58) 


Flight Crew Scheduling (p. 47) 
39 


Clockwise from top left, Cousin_Avi/Shutterstock.com; Goncharuk/Shutterstock.com; 
Gunnar Pippel/Shutterstock.com; Andresr/Shutterstock.com; nostal6ie/Shutterstock.com 
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40 Chapter 2 Matrices 


2.1 Operations with Matrices 


REMARK 


The phrase “if and only if” 
means the statement is true in 
both directions. For example, 
“p if and only if q” means that 
p implies g and q implies p. 


Determine whether two matrices are equal. 

Add and subtract matrices and multiply a matrix by a scalar. 
Multiply two matrices. 

Use matrices to solve a system of linear equations. 


Partition a matrix and write a linear combination of column vectors. 


EQUALITY OF MATRICES 


In Section 1.2, you used matrices to solve systems of linear equations. This chapter 
introduces some fundamentals of matrix theory and further applications of matrices. 

It is standard mathematical convention to represent matrices in any one of the three 
ways listed below. 


1. An uppercase letter such as A, B, or C 
2. A representative element enclosed in brackets, such as [a], [b,], or [c;;] 


3. A rectangular array of numbers 


âi Ay ain 
m an Mn 
amı Am2 Ginn 


As mentioned in Chapter 1, the matrices in this text are primarily real matrices. That 
is, their entries are real numbers. 
Two matrices are equal when their corresponding entries are equal. 


Definition of Equality of Matrices 


Two matrices A = [a,] and B = [b,] are equal when they have the same size 
(m x n) anda, = b,forl S i S mandl <j <n. 


EXAMPLE 1 Equality of Matrices 


Consider the four matrices 


ae[! 2h s[i} can a am f J 


Matrices A and B are not equal because they are of different sizes. Similarly, B and C 
are not equal. Matrices A and D are equal if and only if x = 3. | 


A matrix that has only one column, such as matrix B in Example 1, is a column 
matrix or column vector. Similarly, a matrix that has only one row, such as matrix 
C in Example 1, is a row matrix or row vector. Boldface lowercase letters often 
designate column matrices and row matrices. For instance, matrix A in Example 1 can be 


1 2 
partitioned into the two column matrices a, = | J and a, = | ‘| as shown below. 


a i ate 
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MATRIX ADDITION, SUBTRACTION, 
AND SCALAR MULTIPLICATION 


To add two matrices (of the same size), add their corresponding entries. 


Definition of Matrix Addition 


If A = [a,] and B = [b,] are matrices of size m x n, then their sum is the 


m x n matrix A + B = la, + bj). 


The sum of two matrices of different sizes is undefined. 


EXAMPLE 2 Addition of Matrices 
-1 i] +] 1 elec lal | 
0 1 -1 2} [|o+(-1) 1+2] [-1 3 


| 
eee ee 
| 


REMARK 


It is often convenient to rewrite ç, 
the scalar multiple cA by 
factoring c out of every entry 
in the matrix. For example, 
factoring the scalar 5 out of 


0 
2 1 0 0 1}. ; 
= 3 3) = ; d. F 0 | + È ] is undefined. 


When working with matrices, real numbers are referred to as scalars. To multiply 


the matrix below gives a matrix A by a scalar c, multiply each entry in A by c. 
1 _3 
E | = ig p Definition of Scalar Multiplication 
2 2 


If A = [a,] is an m x n matrix and c is a scalar, then the scalar multiple of A by 
c is the m x n matrix cA = [ca;;]. 


You can use —A to represent the scalar product (— 1)A. If A and B are of the same 
size, then A — B represents the sum of A and (— 1)B. That is, A — B = A + (—1)B. 


EXAMPLE 3 Scalar Multiplication and Matrix Subtraction 


For the matrices A and B, find (a) 3A, (b) — B, and (c) 3A — B. 


1 2 4 2 0 0 
a=|-3 0o -1| ad B=| 1 -4 3 
2 1 2 -1 3 2 
SOLUTION 
12 4 3(1) 3(2) 3(4) 3 6 12 
4434 0 =i) =| a3) 50) Be \s9° o -=3 
2 1 2 3(2) 30) 3(2) 6 3 6 
0 o] -2 0 o 
b === 1 -4 3ļl=|=i 4 =3 
-1 3 2 1 -3 -2 
3 6 2 2 0 0 1 6 12 
e 34-B=|-9 o -3ļ|-| ı -4 3ļ=ļ|-10 4 -6 
6 3 6| |- 3 2 7 0 4 | 
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Chapter 2 Matrices 


MATRIX MULTIPLICATION 


Another basic matrix operation is matrix multiplication. To see the usefulness of 
this operation, consider the application below, in which matrices are helpful for 
organizing information. 

A football stadium has three concession areas, located in the south, north, and west 
stands. The top-selling items are peanuts, hot dogs, and soda. Sales for one day are 
given in the first matrix below, and the prices (in dollars) of the three items are given 
in the second matrix. 


Numbers of Items Sold 
Peanuts Hot Dogs Sodas Selling Price 


South Stand | 120 250 305 2.00 | Peanuts 
North Stand |207 140 419 3.00 | Hot Dogs 
West Stand 29 120 190 2.75 | Soda 


To calculate the total sales of the three top-selling items at the south stand, multiply 
each entry in the first row of the matrix on the left by the corresponding entry in the 
price column matrix on the right and add the results. The south stand sales are 


(120)(2.00) + (250)(3.00) + (305)(2.75) = $1828.75 South stand sales 
Similarly, the sales for the other two stands are shown below. 

(207)(2.00) + (140)(3.00) + (419)(2.75) = $1986.25 North stand sales 

(29)(2.00) + (120)(3.00) + (190)(2.75) = $940.50 West stand sales 


The preceding computations are examples of matrix multiplication. You can write 
the product of the 3 x 3 matrix indicating the number of items sold and the 3 x 1 
matrix indicating the selling prices as shown below. 


120 250 305 |} 2.00 1828.75 
207 140 419 || 3.00] = | 1986.25 
29 120 190] 2.75 940.50 


The product of these matrices is the 3 x 1 matrix giving the total sales for each of the 
three stands. 

The definition of the product of two matrices shown below is based on the ideas 
just developed. Although at first glance this definition may seem unusual, you will see 
that it has many practical applications. 


Definition of Matrix Multiplication 


If A = [a,]is an m x n matrix and B = [b,] is ann x p matrix, then the product 
AB is an m x p matrix 


AB = Lei 


where 


n 
= D aby 
k=1 


= abi; + apb; + agbs; +---+apb 


in” nj" 


This definition means that to find the entry in the ith row and the jth column of 
the product AB, multiply the entries in the ith row of A by the corresponding entries in 
the jth column of B and then add the results. The next example illustrates this process. 
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Arthur Cayley 
(1821-1895) 
British mathematician 
Arthur Cayley is credited 
with giving an abstract 
definition of a matrix. 
Cayley was a Cambridge 
University graduate and a 
lawyer by profession. He 
began his groundbreaking 
work on matrices as he 
studied the theory of 
transformations. Cayley 
also was instrumental 
in the development of 
determinants (discussed in 
Chapter 3). Cayley and two 
American mathematicians, 
Benjamin Peirce 
(1809-1880) and his 
son, Charles S. Peirce 
(1839-1914), r 
are credited Pale 
with developing ERER 
Ime 


“matrix algebra.” 
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EXAMPLE 4 Finding the Product of Two Matrices 


Find the product AB, where 


-1 3 

A=| 4 -2| and s=} i 
5 0 

SOLUTION 


First, note that the product AB is defined because A has size 3 x 2 and B has size 2 x 2. 
Moreover, the product AB has size 3 x 2, and will take the form 


=l 3 Ë ë 
=9 J 11 12 
4 -2 =|ĉi Cyl 
—4 1 
5 0 C31 C32 


To find c,, (the entry in the first row and first column of the product), multiply 
corresponding entries in the first row of A and the first column of B. That is, 


éy = EUG 2) + 8 =4) 9 


-1 3 = 2 co ĉis 
4 -2 E d =| Cy, Coo |. 
5 0 Cai C39 


Similarly, to find c,,, multiply corresponding entries in the first row of A and the 
second column of B to obtain 


cp = (—1)2) + 3)0) =1 


el 3 —3 p) =9 ae 
4 —2 =i |5| ou 2f 
5 0 Ca, C30 


Continuing this pattern produces the results shown below. 


Cy) = (4)(—3) + (-2)(-4) = —-4 
Cop = (4)2) +(-2)0) = 6 
c3 = (5)(—3) + (0)(-4) = -15 
c33 = (5)(2) =+ (0)(1) = 10 
The product is 
-1 3 -9 1 
AB = -2 E | =| -4 6l. 
-15 10 | 


Be sure you understand that for the product of two matrices to be defined, the 
number of columns of the first matrix must equal the number of rows of the second 
matrix. That is, 


A B = AB. 
meh Rp mxp 
Equal 
Size of AB 


So, the product BA is not defined for matrices such as A and B in Example 4. 


Photo Researchers/Getty Images 
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44 Chapter 2 Matrices 


The general pattern for matrix multiplication is shown below. To obtain the 
element in the ith row and the jth column of the product AB, use the ith row of A and the 
jth column of B. 


Ai} i2 413 - - - Ay baib b b Ci Cia ++ C1; a as se Cip 
aj ap a a ae 6s én Ë c c 
2, 2D TRIB E On b,, b b b iiey y ere oe ND st ce oe Op 
: : : : 21 922 - + + Oy + + + Dap > : s : 
oie ` bz; b b b, | = i 
31 732 ° > - E = O35 me 
Gi, Gig 43 +--+ Gin : : : : Ci Ci (Cif Cip 
oe ` ILD, b D b : ; 
nl “n2 ° ° R e e “np 
Amni Am2 Am3 + + + Amn Cmi Cm Cmj ee Cmp 
aby; + anba + agby ++ + + Ginby = Cy 


DISCOVERY 


Let 


1 2 0 1 
a-|; 3 and s= A 


1. Find A + B and B + A. Is matrix addition commutative? 


2. Find AB and BA. Is matrix multiplication commutative? 


EXAMPLE 5 Matrix Multiplication 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


i Į 0 l | : TE 7 =] 
2 =] =2 = 1-1 —3 6 6 
223 ke a 2%3 
TEEF 
“1-2 5|L0 1 =2 5 
2x2 222 2x2 
EEE 
1 1 1 =f (0) 1 
262 2.9% 2 2x2 
2 
d. [1 -2 -3] -1| = [1] 
1 
ie 3% 1 ea 
2, 2 -4 —-6 
e.|-1|f1 -2 -3]=]-1 2 3 
1 I =2- -=3 


Si 143 3x3 | 


Note the difference between the two products in parts (d) and (e) of Example 5. 
In general, matrix multiplication is not commutative. It is usually not true that the 
product AB is equal to the product BA. (See Section 2.2 for further discussion of 
the noncommutativity of matrix multiplication.) 
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TECHNOLOGY 


Many graphing utilities and 
software programs can 
perform matrix addition, scalar 
multiplication, and matrix 
multiplication. When you use 

a graphing utility to check one 
of the solutions in Example 6, 
you may see something similar 
to the screen below. 


CAJ 
CC1 -2 1 ] 
[2 -2]] 

CBI 
clea 
[4] 
C71] 

CAJ*CB] 

CLO] 
EOws 


The Technology Guide at 
CengageBrain.com can help 
you use technology to perform 
matrix operations. 
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SYSTEMS OF LINEAR EQUATIONS 


One practical application of matrix multiplication is representing a system of linear 
equations. Note how the system 


4X1 + aX + 3X3 = b; 
aX; + aX + a23% = b, 
3X1 + a32% + 33X3 = b3 


can be written as the matrix equation Ax = b, where A is the coefficient matrix of the 
system, and x and b are column matrices. 


âi Qi 3 I XY bi 
l a» az || Xp] = |b 
a31 32 33, IL %3 b; 

A x = b 


EXAMPLE 6 Solving a System of Linear Equations 


Solve the matrix equation Ax = 0, where 


x) 


1 -2 1 0 
a=; 3 | x= |x,|, and o= fo 


X3 
SOLUTION 


As a system of linear equations, Ax = 0 is 


Xx, — + x =0 
2x, + 3x, — 2x, = 0. 


Using Gauss-Jordan elimination on the augmented matrix of this system, you obtain 
1 
1 0 =z 0 
4 . 
0 1 =z 0 
So, the system has infinitely many solutions. Here a convenient choice of a parameter 
is x, = 7t, and you can write the solution set as 
xX, =t x, =4f, x, = 7t, tis any real number. 
In matrix terminology, you have found that the matrix equation 
x 
x, | = 
2 3 =2 0 
X3 


has infinitely many solutions represented by 


x, t 1 
x= |x,|} = |4t|= 44], fis any scalar. 
X3 Tt 7 


That is, any scalar multiple of the column matrix on the right is a solution. Here are 
some sample solutions: 


1 2 0 =] 


T 14 0 =] ui 
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Chapter 2 Matrices 


PARTITIONED MATRICES 


The system Ax = b can be represented in a more convenient way by partitioning the 
matrices A and x in the manner shown below. If 


4, 42 +--+ An X bı 
üj Gy ... a x b 
paie a eea ed ed 
anm 1 Am2 oe S amn Xn by 


are the coefficient matrix, the column matrix of unknowns, and the right-hand side, 
respectively, of the m x n linear system Ax = b, then 


Gy, aa sre Gy, |X, 
“21 22 on %2 =b 
Amy Gnr o= Ann || Xp 
aX + dX He + Ay) Xx, 
zaki T aX H+ + + Ay) X, =b 
Gaa Tapk e e + + aX, 
ay a2 Ain 
x, “21 +X “22 aah cote oe] 2n =b. 
amı Am2 amn 
In other words, 
Ax =x,a, + xa, t:e txa, = b 
where a,, a,. . ., a, are the columns of the matrix A. The expression 
aii a2 Gn 
x) a + Xp ~ seca a 
amı Am2 amn 
is called a linear combination of the column matrices a,,a,,. . ., a, with coefficients 


Kis Ways. ie ges 


Linear Combinations of Column Vectors 


The matrix product Ax is a linear combination of the column vectors a,, 
a. . .,a, that form the coefficient matrix A. 


ay aj Gin 


a a a 
= +x 22 a a 2n 


amı Ang 


Furthermore, the system 


is consistent if and only if b can be expressed as such a linear combination, where 
the coefficients of the linear combination are a solution of the system. 
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2.1 Operations with Matrices 47 


EXAMPLE 7 Solving a System of Linear Equations 


The linear system 
x, + 2x, + 3x, = 0 
4x, + 5x, + 6x, = 3 
Txi + 8x, + 9x, = 6 


can be rewritten as a matrix equation Ax = b, as shown below. 


1 2 3 0 
xl 4l + x] 5] + x) 6] =] 3 
7 8 9 6 
Using Gaussian elimination, you can show that this system has infinitely many 
solutions, one of which is x, = 1, x, = 1,x, = —1. 
1 2 3 0 
114) + 1/5} + (—1)6|=13 
7 8 9 6 


That is, b can be expressed as a linear combination of the columns of A. This 
representation of one column vector in terms of others is a fundamental theme of 
linear algebra. | 


Just as you partition A into columns and x into rows, it is often useful to consider 
an m x n matrix partitioned into smaller matrices. For example, you can partition the 
matrix below as shown. 


i 2 0 0 i 2/0 0 
3 4 0 0 3 4/0 0 
=í = 2 j -1 2 |2. í 


You can also partition the matrix into column matrices 


1 2 0 0 
3} 4 | 0 | OJ=[e, go ec e] 
St aed 2 1 


or row matrices 


ies) 
A 
iS 
iS 
ll 
m 
N 


l 
— 

| 
N 
N 
— 
a] 

W 


LINEAR Many real-life applications of linear systems involve 

ALGEBRA enormous numbers of equations and variables. For 
example, a flight crew scheduling problem for American 

APPLIED Airlines required the manipulation of a matrix with 
837 rows and more than 12,750,000 columns. To solve 
this application of linear programming, researchers 
partitioned the problem into smaller pieces and solved 
it on a computer. (Source: Very Large-Scale Linear 
Programming. A Case Study in Combining Interior Point and 
Simplex Methods, Bixby, Robert E., et al., Operations Research, 
40, no. 5) 


Andresr/Shutterstock.com 
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2.1 Exercises 


See CalcChat.com for worked-out solutions to odd-numbered exercises. 


Equality of Matrices In Exercises 1—4, find x and y. 
1 |; >] = [5 r 
“E7 y 7 2 


: E Ter A 
t| y 8 12 8 
5 


16 4 4 16 4 2x+1 4 
3./-3 13 15 6}/=/-3 13 15. 3x 
0 2 4 0 0 2 3y-5 0 
x+2 8 =3 2x + 6 S =3 

4. 1 2y 2x | = 1 18 -8 
7 =2 yt+2 7 —2 Ii 


Operations with Matrices In Exercises 5-10, find, if 
possible, (a) A + B, (b) A — B, (c) 2A, (d) 2A — B, and 
(e) B + 4A. 


{i 2 -3 -2 
5. 4=|) |, B=[ "3 | 


6 -1 1 4 
6A =| 2 , B=|-1 5 
-3 5 1 10 
> g f z7 = 4 
ma=|_? -1 Al FE 1 =| 
3 2-1 0 2 1 
SA=|2 4 5|, B=|5 4 2 
o 1 2 23 it -0 
6 0 3 8 -1 
sael —4 l tel; | 
3 
10..A4=| 2], B=[-4 6 2] 
=] 


11. Find (a) c,, and (b) cj}, where C = 2A — 3B, 


a-ji 4 a! cr a 2 7 


3 1 2 0 =S 1 
12. Find (a) c,, and (b) c33, where C = 5A + 2B, 
4 11 -9 1 O 5 
A=] 0 3 2], and B=|-4 6 11). 
=3 1 1 -6 4 9 


13. Solve for x, y, and z in the matrix equation 


CE a 


14. Solve for x, y, z, and w in the matrix equation 


Boa eh 


Finding Products of Two Matrices In Exercises 15-28, 
find, if possible, (a) AB and (b) BA. 


1 2 2. =I 
safi 2] s-[2 “I 


19. A = 


20. A = 


NON AA -e 
= 


2 
2.A=[23 2 1), B=|3 
0 


=i 
2 
mA=| 5, B=[22 1 3 J 
1 
4 3 
23. A = a -s| =| ‘| 
0 2 
2 1 
a a-i “kaji 3 
J =l 
=i ð 2 
25.4=|4 0 2|, B=|- 
oe 1 
2 2 yö 1 3 
AS) a Hl =o) Bele 2 =d =i 
= 1.59 2 1 4 3 
6 
2 
7.A=| 5) B=[10 12] 
6 
1 0 3-2 4 1 6 
28.4 =| ¢ is eai aksel J] 
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Matrix Size In Exercises 29-36, let A, B, C, D, and E 
be matrices with the sizes shown below. 
A: 3x4 B: 3x4 C: 4x2 D: 4x2 E: 4x3 


If defined, determine the size of the matrix. If not 
defined, explain why. 


29. A+B 30. C+E 
31. 5D 32. —4A 
33. AC 34. BE 

35. E — 2A 36. 2D + C 


Solving a Matrix Equation In Exercises 37 and 38, 
solve the matrix equation Ax = 0. 


X 
2 =) =] : 0 
Tie ee 0- [9 


X3 
i 4 3 a 0 
38. A=|1 -1 0 1|, x=|72|, o=/0 
0 1-1 2 %3 0 
X4 


Solving a System of Linear Equations In Exercises 
39-48, write the system of linear equations in the form 
Ax = b and solve this matrix equation for x. 


39. -x +x, =4 40. 2x, + 3x, = 5 
—2x, +x, =0 x, + 4x, = 10 
41. —2x, — 3x, = —4 42. —4x, + 9x, = -13 

6x, + x = —36 x, —-3x%,= 12 
43. x, —2x,+3x,= 9 
Zk. SE = 6 
2x, — 5x, + 5x, = 17 


44. x, + x,-3x,=-1 
=x, F 2x5 = 1 
A= Ht w= 2 
45. x, — 5x, + 2x, = —20 
3x, + X= 8 


=2x_ + Sx, = —16 
46.x,- x, +4x,= 17 


Jr 3x5 =-=]11 

— 6x, + 5x, = 40 
47. 2x, — x, + x= 3 

3x5 X3 xX, = 
Xi + x, — 3x, = =4 
Hy ta + 2K, = 0 
48. x, + x, = 
X + X, = 
X3 + X4 = 

xX, tx; =0 


= k= Py he SD 


2.1 Exercises 49 


Writing a Linear Combination In Exercises 49-52, 
write the column matrix b as a linear combination of the 
columns of A. 


I, =i 2 —1 
biel. 2) al 


1 2 4 1 
50. A =|-1 0 2), b= ]3 
1 3 2 
1 I =5 3 
51 =|1 0 -1j b=]1 
2% -=b s] 0 
=3 5 =22 
52. A = 3 4), b= 4 
4 -8 32 


Solving a Matrix Equation In Exercises 53 and 54, 
solve for A. 


1 2 1 0 
sh sah T 
Z =] 1 0 
a asl a 


Solving a Matrix Equation In Exercises 55 and 56, 
solve the matrix equation for a, b, c, and d. 


sda ale alho 2l 
n La 7a] 


Diagonal Matrix In Exercises 57 and 58, find the 
product AA for the diagonal matrix. A square matrix 


ay, 0 0 0 
0 Wp 0 0 
A=|0 o% 0 


0 0 0 ... G 


is a diagonal matrix when all entries that are not on the 
main diagonal are zero. 


= 0 0 2 0 0 
57. A =| 0 2 0j 58 A=/0 -3 0 
0 0 3 0 0 0 


Finding Products of Diagonal Matrices In Exercises 
59 and 60, find the products AB and BA for the diagonal 
matrices. 


2 0 =a 0 
sa- fs 9 


3 0 0 = 0 0 
60. A=|]0 -5 O|, B=] 0 4 0 
0 0 0 0 0 12 
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61. 


62. 


Chapter 2 Matrices 


Guided Proof Prove that if A and B are diagonal 
matrices (of the same size), then AB = BA. 


Getting Started: To prove that the matrices AB and BA 
are equal, you need to show that their corresponding 
entries are equal. 
(i) Begin your proof by letting A = [a;] and B = [b;] 
be two diagonal n x n matrices. 
(ii) The ijth entry of the product AB is 


n 
Cy ~ > CD yy: 
k=1 


(iii) Evaluate the entries Cy for the two cases i # j and 
i=j. 

(iv) Repeat this analysis for the product BA. 

Writing Let A and B be 3 x 3 matrices, where A is 

diagonal. 

(a) Describe the product AB. Illustrate your answer 
with examples. 

(b) Describe the product BA. Illustrate your answer 
with examples. 


(c) How do the results in parts (a) and (b) change when 
the diagonal entries of A are all equal? 


Trace of a Matrix In Exercises 63-66, find the 
trace of the matrix. The trace of an n xn matrix A 
is the sum of the main diagonal entries. That is, 
Tr(A) = a,, ta, ++ +++ 4,,. 


63. 


65. 


67. 


68. 


69. 


70. 


71. 


1 2 3 1 0 0 
0 =2 4 64. | 0 1 0 
3 1 3 0 0 1 
1 0 2 1 1 4 3 2 
0 IL =] 2 4 0 6 1 
4 2 1 0 Ob: 3 6 2 1 
0 0 5 1 2 1 I =3 


Proof Prove that each statement is true when A and B 
are square matrices of order n and c is a scalar. 


(a) Tr(A + B) = Tr(A) + Tr(B) 
(b) Tr(cA) = cTr(A) 


Proof Prove that if A and B are square matrices of 
order n, then Tr(AB) = Tr(BA). 


Find conditions on w, x, y, and z such that AB = BA for 
the matrices below. 


x 1 1 
J e =| || 


Verify AB = BA for the matrices below. 
a= hes a —sin “| ee B —sin A 
sina cosa sinf cos B 


Show that the matrix equation has no solution. 


i atsl 1 


72. 


73. 


74. 


75. 


76. 


77. 


79. 


Show that no 2 x 2 matrices A and B exist that satisfy 
the matrix equation 


1 0 
AB — BA = 
lo i 


Exploration Leti = ./—1 and let 


i (0) 0 =i 
aeli 4 and j=? | 


(a) Find A?, A*, and A*t. (Note: A? = AA, 
A} = AAA = A?A, and so on.) Identify any similarities 
with 7”, ©, and i*. 

(b) Find and identify B?. 

Guided Proof Prove that if the product AB is a square 

matrix, then the product BA is defined. 

Getting Started: To prove that the product BA is 

defined, you need to show that the number of columns 

of B equals the number of rows of A. 

(i) Begin your proof by noting that the number of 
columns of A equals the number of rows of B. 

(ii) Then assume that A has size m x n and B has size 
nx p. 

(iii) Use the hypothesis that the product AB is a 

square matrix. 

Proof Prove that if both products AB and BA are 

defined, then AB and BA are square matrices. 

Let A and B be matrices such that the product AB is 

defined. Show that if A has two identical rows, then the 

corresponding two rows of AB are also identical. 

Let A and B be n x n matrices. Show that if the ith 

row of A has all zero entries, then the ith row of AB 

will have all zero entries. Give an example using 2 x 2 

matrices to show that the converse is not true. 


. CAPSTONE Let matrices A and B be of 
sizes 3 x 2 and 2 x 2, respectively. Answer each 
question and explain your answers. 


Is it possible that A = B? 
Is A + B defined? 
Is AB defined? If so, is it possible that AB = BA? 


Agriculture A fruit grower raises two crops, apples 

and peaches. The grower ships each of these crops to 

three different outlets. In the matrix 

A= F 100 | 
100 175 125 

a; represents the number of units of crop i that the 

grower ships to outlet j. The matrix 


B = [$3.50 $6.00] 


represents the profit per unit. Find the product BA and 
state what each entry of the matrix represents. 
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80. Manufacturing A corporation has three factories, 
each of which manufactures acoustic guitars and 
electric guitars. In the matrix 

E 2 50 | 

~ [35 100 70 
a; represents the number of guitars of type i produced 
at factory j in one day. Find the production levels when 
production increases by 20%. 


81. Politics In the matrix 


From 
SSS 
R D I 


0.6 01 O1}R 
P=/02 0.7 0.1|D >To 
0.2 0.2 O8]1 


each entry p; (i # j) represents the proportion of the 
voting population that changes from party j to party i, 
and p; represents the proportion that remains loyal to 
party 7 from one election to the next. Find and interpret 
the product of P with itself. 


82. Population The matrices show the numbers of 
people (in thousands) who lived in each region of 
the United States in 2010 and 2013. The regional 
populations are separated into three age categories. 
(Source: U.S. Census Bureau) 


2010 
0-17 18—64 65+ 
Northeast 12,306 35,240 7830 
Midwest 16,095 41,830 9051 
South 27,799 72,075 14,985 
Mountain 5698 13,717 2710 
Pacific 12,222 31,867 5901 
2013 
0-17 18-64 65+ 
Northeast | 12,026 35,471 8446 
Midwest 15,772 41,985 9791 
South 27,954 73,703 16,727 
Mountain 5710 14,067 3104 
Pacific 12,124 32,614 6636 


(a) The total population in 2010 was approximately 
309 million and the total population in 2013 was 
about 316 million. Rewrite the matrices to give the 
information as percents of the total population. 

(b) Write a matrix that gives the changes in the percents 
of the population in each region and age group from 
2010 to 2013. 

(c) Based on the result of part (b), which age group(s) 
show relative growth from 2010 to 2013? 


2.1 Exercises 51 


Block Multiplication In Exercises 83 and 84, perform the 
block multiplication of matrices A and B. If matrices 
A and B are each partitioned into four submatrices 
A= ie | and B= [Bs a] 
Ax Ay, B 21 B 22: 

then you can block multiply A and B, provided the sizes of 
the submatrices are such that the matrix multiplications 
and additions are defined. 

Ay, A Bı B 
AB = | 11 z2] | 11 z2] 

Az Az B 21 B 22 

= es + A,B, 


AyBy + oe] 
AxB F A,B, 


AxBy + A,B, 


1 ayo op [+ 2/2 
83.A4=|0 11/10 4O|, B= 

0 ü lZ 1 0 ale 

0 o|3 

ere o 

0 0o 1 5 6 7 18 

a ag Fi o 2 Sai 

o0o-1 l0 0 5 6 7l8 


True or False? In Exercises 85 and 86, determine 
whether each statement is true or false. If a statement 
is true, give a reason or cite an appropriate statement 
from the text. If a statement is false, provide an example 
that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


85. (a) For the product of two matrices to be defined, the 
number of columns of the first matrix must equal 
the number of rows of the second matrix. 


(b) The system Ax = b is consistent if and only if b 
can be expressed as a linear combination of the 
columns of A, where the coefficients of the linear 
combination are a solution of the system. 


86. (a) If A is an m x n matrix and B is an n x r matrix, 
then the product AB is an m x r matrix. 


(b) The matrix equation Ax = b, where A is the 
coefficient matrix and x and b are column matrices, 
can be used to represent a system of linear equations. 


87. The columns of matrix T show the coordinates of the 
vertices of a triangle. Matrix A is a transformation matrix. 


0 =i 1 2 3 

a=]; of r=|; 4 | 

(a) Find AT and AAT. Then sketch the original 
triangle and the two transformed triangles. What 
transformation does A represent? 

(b) A triangle is determined by AAT. Describe the 
transformation process that produces the triangle 
determined by AT and then the triangle determined 
by T. 
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2.2 Properties of Matrix Operations 


Use the properties of matrix addition, scalar multiplication, and 
zero matrices. 


Use the properties of matrix multiplication and the identity matrix. 


Find the transpose of a matrix. 


ALGEBRA OF MATRICES 


In Section 2.1, you concentrated on the mechanics of the three basic matrix operations: 
matrix addition, scalar multiplication, and matrix multiplication. This section begins to 
develop the algebra of matrices. You will see that this algebra shares many (but not 
all) of the properties of the algebra of real numbers. Theorem 2.1 lists several properties 
of matrix addition and scalar multiplication. 


THEOREM 2.1 Properties of Matrix Addition 
and Scalar Multiplication 
If A, B, and C are m x n matrices, and c and d are scalars, then the properties 


below are true. 
-A+B=B+A Commutative property of addition 


~-A+(B+C)=(A+B)+C Associative property of addition 

. (cd)A = c(dA) Associative property of multiplication 
. IASA Multiplicative identity 

. c(A + B) = cA + cB Distributive property 

. (c + d)A = cA + dA Distributive property 


PROOF 
The proofs of these six properties follow directly from the definitions of matrix addition, 
scalar multiplication, and the corresponding properties of real numbers. For example, to 
prove the commutative property of matrix addition, let A = [a] and B = [b, |. Then, 
using the commutative property of addition of real numbers, write 

A +B = |a; + b,] = [b, + a;] = B+ A. 
Similarly, to prove Property 5, use the distributive property (for real numbers) of 
multiplication over addition to write 


c(A + B) = [cla, + b,)] = [cay + cb] = cA + cB. 


The proofs of the remaining four properties are left as exercises. (See Exercises 61—64.) 


The preceding section defined matrix addition as the sum of two matrices, making 
it a binary operation. The associative property of matrix addition now allows you to 
write expressions such as A + B + Cas (A + B) + Coras A + (B + C). This same 
reasoning applies to sums of four or more matrices. 


EXAMPLE 1 Addition of More than Two Matrices 


To obtain the sum of four matrices, add corresponding entries as shown below. 


elekli F 
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REMARK 
Property 2 can be described 
by saying that matrix —A is the 
additive inverse of A. 


2.2 Properties of Matrix Operations 53 


One important property of the addition of real numbers is that the number 0 
is the additive identity. That is, c + 0 = c for any real number c. For matrices, 
a similar property holds. Specifically, if A is an m x n matrix and O,,, is the 
m x n matrix consisting entirely of zeros, then A + O,,, = A. The matrix O,,,, is 


a zero matrix, and it is the additive identity for the set of all m x n matrices. For 
example, the matrix below is the additive identity for the set of all 2 x 3 matrices. 


0 0 0 
oami 0 a 
When the size of the matrix is understood, you may denote a zero matrix simply by O 
or 0. 


The properties of zero matrices listed below are relatively easy to prove, and their 
proofs are left as an exercise. (See Exercise 65.) 


THEOREM 2.2 Properties of Zero Matrices 


If A is an m x n matrix and c is a scalar, then the properties below are true. 


1A+O,, =A 


2. A+ (—A) =O 
3. IfcA =O 


mn 


then c = Oor A = Om 


mn? 


The algebra of real numbers and the algebra of matrices have many similarities. 
For example, compare the two solutions below. 


m x n Matrices 
(Solve for X.) 
X+A=B 
X+A+t(—-A) =B+ (-A) 
X+O=B-A 
X=B-A 


Real Numbers 
(Solve for x.) 


xta=b 
x+a+(—a)= b + (-a) 
x+0=b-a 
x=b-a 


Example 2 demonstrates the process of solving a matrix equation. 


EXAMPLE 2 Solving a Matrix Equation 


Solve for X in the equation 3X + A = B, where 


l =2 =3 4 
sa ] and B=| 2 tI 


SOLUTION 

Begin by solving the equation for X to obtain 
3X =B-A 
X = {(B — A). 


Now, using the matrices A and B, you have 
ifm A_i E) 
a a. 
_ T s] 
I 2 =2 


II 
[—-—__ a 
| 
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REMARK 


Note that no commutative 
property of matrix 
multiplication is listed in 
Theorem 2.3. The product 
AB may not be equal to the 
product BA, as illustrated in 
Example 4 on the next page. 


PROPERTIES OF MATRIX MULTIPLICATION 


The next theorem extends the algebra of matrices to include some useful properties of 
matrix multiplication. The proof of Property 2 is below. The proofs of the remaining 
properties are left as an exercise. (See Exercise 66.) 


THEOREM 2.3 Properties of Matrix Multiplication 


If A, B, and C are matrices (with sizes such that the matrix products are defined), 
and c is a scalar, then the properties below are true. 

1. A(BC) = (AB)C Associative property of multiplication 

2. A(B + C) = AB + AC 
3. (A + B)C = AC + BC 
4. c(AB) = (cA)B = A(cB) 


Distributive property 
Distributive property 


PROOF 


To prove Property 2, show that the corresponding entries of matrices A(B + C) and 
AB + AC are equal. Assume A has size m x n, B has size n x p, and C has size n x p. 
Using the definition of matrix multiplication, the entry in the ith row and jth column 
of A(B + C) is a,(by + c) + aplba; + c3) ++ + + + aig(d,; + C,;)- Moreover, the 
entry in the ith row and jth column of AB + AC is 


nj 


-+ a,c). 


(anbi; + anba; +-+-+a.b inCnj 


in i) nt (ac); apj ++ 
By distributing and regrouping, you can see that these two ijth entries are equal. So, 
A(B + C) = AB + AC. m 


The associative property of matrix multiplication permits you to write such matrix 
products as ABC without ambiguity, as demonstrated in Example 3. 


EXAMPLE 3 


Matrix Multiplication Is Associative 


Find the matrix product ABC by grouping the factors first as (AB)C and then as A(BC). 
Show that you obtain the same result from both processes. 


=1 0 
1 =2 1 0 2 
cle oft 2 Fal) G 
2 1 3 2 1 2 4 
SOLUTION 
Grouping the factors as (AB)C, you have 
= 0 
1 —2]/ 1 0 2 
aac=([) “ifs -2 i) 
4 
-[ 4 | 7 ilaj] ‘| 
= 2 3 2 4 13 14 


Grouping the factors as A(BC), you obtain the same result. 


-1 0 
1 -2| [1 0 2 
awo =|) “| f -2 | : ’ 


=| Tila l= Ls 1l 
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The next example shows that even when both products AB and BA are defined, 
they may not be equal. 


EXAMPLE 4 Noncommutativity of Matrix Multiplication 


Show that AB and BA are not equal for the matrices 


a ie! 3 = |e =I 
a=|) S| and B=(5 I 
SOLUTION 


a 3B -E ee aie 2 


AB + BA | 


Do not conclude from Example 4 that the matrix products AB and BA are never 
equal. Sometimes they are equal. For example, find AB and BA for the matrices below. 


1 2 —2 4 
a-|t ‘| and z=] 2 E 


You will see that the two products are equal. The point is that although AB and BA are 
sometimes equal, AB and BA are usually not equal. 

Another important quality of matrix algebra is that it does not have a general 
cancellation property for matrix multiplication. That is, when AC = BC, it is not 
necessarily true that A = B. Example 5 demonstrates this. (In the next section you will 
see that, for some special types of matrices, cancellation is valid.) 


EXAMPLE 5 An Example in Which Cancellation Is Not Valid 


Show that AC = BC. 


SOLUTION 
1 3 1 -2 —2 4 2 4 1 -2 —2 4 

ac =|, les leli hac =|; Nes l= (7) | 

AC = BC, even though A # B. m 


You will now look at a special type of square matrix that has 1’s on the main 
diagonal and 0’s elsewhere. 


1 Ogee O 

peo de 

~ OQ srs I 
nxn 


For instance, for n = 1, 2, and 3, 


1 0 0 
1 
n= =|) il Lalo r øl 
0 0 1 


When the order of the matrix is understood to be n, you may denote J, simply as J. 

As stated in Theorem 2.4 on the next page, the matrix 7, serves as the identity 
for matrix multiplication; it is the identity matrix of order n. The proof of this theorem 
is left as an exercise. (See Exercise 67.) 
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REMARK 


Note that if A is a square matrix 
of order n, then Al, = ĪA = A. 


THEOREM 2.4 Properties of the Identity Matrix 


If A is a matrix of size m x n, then the properties below are true. 


1. AL=A LIAA 
EXAMPLE 6 Multiplication by an Identity Matrix 
3 =2 1 0 e 22 1 0 Oj] -2 =2 
a 4 0 | l = 4 0 b.|0 1 0 1| = 1 
0 1 
=f 1l -1 1 0 Oo 1] 4 4 wl 


For repeated multiplication of square matrices, use the same exponential notation 
used with real numbers. That is, A! = A, A? = AA, and for a positive integer k, A* is 


Ak=AA---A, 
———— 
k factors 


It is convenient also to define A? = Z, (where A is a square matrix of order n). These 
definitions allow you to establish the properties (1) AJA‘ = A/** and (2) (A/)‘ = A, 
where j and k are nonnegative integers. 


Repeated Multiplication of a Square Matrix 
For the matrix A = f “ai 
æ= (3 vals dG olle als ol- [3 l 
3 0 olla ol [6 -33 0 3 -6| wl 


In Section 1.1, you saw that a system of linear equations has exactly one solution, 
infinitely many solutions, or no solution. You can use matrix algebra to prove this. 


W 


THEOREM 2.5 Number of Solutions of a Linear System 


For a system of linear equations, precisely one of the statements below is true. 


1. The system has exactly one solution. 
2. The system has infinitely many solutions. 
3. The system has no solution. 


PROOF 


Represent the system by the matrix equation Ax = b. If the system has exactly one 
solution or no solution, then there is nothing to prove. So, assume that the system has 
at least two distinct solutions x, and x,. If you show that this assumption implies that 
the system has infinitely many solutions, then the proof will be complete. When x, and 
x, are solutions, you have Ax, = Ax, = b and A(x, — x,) = O. This implies that the 
(nonzero) column matrix x, = xX, — X, is a solution of the homogeneous system of 
linear equations Ax = O. So, for any scalar c, 


A(x, + cx,) = Ax, + A(cx,) = b + c(Ax,) = b + cO =b. 


Then x, + cx, is a solution of Ax = b for any scalar c. There are infinitely many 
possible values of c and each value produces a different solution, so the system has 
infinitely many solutions. | 
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DISCOVERY 


1 2 
Leta =| 4 


i 

—1 i 

Find (AB)’, A™B’, 
and BTA’. 

Make a conjecture 
about the transpose 


of a product of two 
square matrices. 


l and 


Select two other 
square matrices to 
check your conjecture. 


REMARK 


Note that the square matrix in 
part (c) is equal to its transpose. 
Such a matrix is symmetric. 

A matrix A is symmetric when 
A = A’. From this definition 

it should be clear that a 
symmetric matrix must be 
square. Also, if A = [a;;] is 

a symmetric matrix, then 

aj = a; for all i # j. 
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THE TRANSPOSE OF A MATRIX 


The transpose of a matrix is formed by writing its rows as columns. For example, if 
A is the m x n matrix 


ai i2 i3 a 
a An 23 >.. An 
A =| Gy; a3 l3 ..- Gy, 
Qin 1 Am2 Am3 a Amn 
Size: m x n 


then the transpose, denoted by A’, is the n x m matrix 


Gy, Ag, 43, 2 ee Any 
di2 An 430 + © + Ang 
i 
A! =| G3 3 433 >.. Any 
Gin Ayn, azn Ginn 
Size: n x m 


i EXAMPLE 8 Transposes of Matrices 


Find the transpose of each matrix. 


; 1 2 3 1 2 0 0 1 
a=] b. B=l4 5 6| e&ec=l2 ı ol «pelo 4 
7 8 9 0 0 1 1-1 
SOLUTION 
1 4 °7 
a AT=[2 8] b. BT=|2 5 8 
3 6 9 
1 0 
e C=|o. 1 0 a pr = |" Tail 
0 1 | 


THEOREM 2.6 Properties of Transposes 


If A and B are matrices (with sizes such that the matrix operations are defined) 
and c is a scalar, then the properties below are true. 


1. (AT) =A 
. (A + B)! = AT + BT 
. (cA)? = c(AT) 


Transpose of a transpose 
Transpose of a sum 
Transpose of a scalar multiple 
Transpose of a product 


PROOF 


The transpose operation interchanges rows and columns, so Property 1 seems to make 
sense. To prove Property 1, let A be an m x n matrix. Observe that A’ has size n x m 
and (A‘)? has size m x n, the same as A. To show that (AT) = A, you must show that 
the ijth entries are the same. Let a; be the ijth entry of A. Then a, is the jith entry of 
A’, and the ijth entry of (A’)’. This proves Property 1. The proofs of the remaining 
properties are left as an exercise. (See Exercise 68.) | 
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REMARK 


Remember that you reverse the 
order of multiplication when 
forming the transpose of a 
product. That is, the transpose 
of AB is (AB)' = BTA’ and is 
usually not equal to ATB". 


REMARK 


The property demonstrated in 
Example 10 is true in general. 
That is, for any matrix A, the 
matrix AA’ is symmetric. The 
matrix ATA is also symmetric. 
You are asked to prove these 
properties in Exercise 69. 


Properties 2 and 4 can be generalized to cover sums or products of any finite 
number of matrices. For instance, the transpose of the sum of three matrices is 
(A + B + C) = AT + BT + C" and the transpose of the product of three matrices is 
(ABC)? = CTBTA’. 


EXAMPLE 9 Finding the Transpose of a Product 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


Show that (AB)? and BTA’ are equal. 


2 1-2 3 1 
A=;-1 0 3] and B=}]2 -1 
0-2 1l 3° 0 
SOLUTION 
2 1-2)/3 1 2 1 
AB=|-1 0 3]/2 -1|= 6-1 
0-2 I3 0 =] 2 
2 6 =1 
T= 
(48) F =1 | 
2-1 0 
warm [Tt oft 9 -2t=[f 7 a] 
=2 3 I 
(AB)" = BTA" m 
EXAMPLE 10- The Product of a Matrix and Its Transpose 
For the matrix A = = , find the product AA” and show that it is symmetric. 
=1 
SOLUTION 
1 3 10 =6 —5 
AAT=| 0 -2 HE 7 -i= -6 4 2 
—2 =5 2 5 
It follows that AAT = (AAT), so AAT is symmetric. a 
LINEAR Information retrieval systems such as Internet search engines 


ALGEBRA 1 use of matrix theory and linear algebra to keep track of 
ormation. To illustrate, consider a simplified example. You 
APPLIED could represent the occurrences of m available keywords in 
a database of n documents with A, an m x n matrix in which 
an entry is 1 when the keyword occurs in the document 
and 0 when it does not occur in the document. You could 
represent a search with the m x 1 column matrix x, in which 
a 1 entry represents a keyword you are searching and 0 
represents a keyword you are not searching. Then, the n x 1 
matrix product A7x would represent the number of keywords 
in your search that occur in each of the n documents. For 
a discussion on the PageRank algorithm that is used in 
Google’s search engine, see Section 2.5 (page 86). 


Gunnar Pippel/Shutterstock.com 
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Evaluating an Expression In Exercises 1-6, evaluate 
the expression. 


-5 0 7 1 =10 =8 
Ai 3 l lel 14 d 
6 8 0 5 it =7 
E TE A 2 a 
-4 0 1 2 1-2 
a (| 0 2 l-6 —6 l 
4. [5 -2 4 O]+014 6 -18 9) 


sall a eee 


— 


y 


4 11 =5. =] 7 5 
6. -|-2 —-l]+— 3 4/+|-9 -1 
9 3 0 13 6 =1 
Operations with Matrices In Exercises 7-12, perform 
the operations, given a = 3, b = —4, and 
1 2 0 1 0 0 
a E A 4 [s al = i i 
7. aA + bB 8. A+B 
9. ab(B) 10. (a + b)B 


11. (a — b)(A — B) 12. (ab)O 


13. Solve for X in the equation, given 


-4 0 i 2 
A=| 1 -5| and B=|-2 1 
-—3 2 4 4 


(a) 3X + 2A=B (b) 2A — 5B = 3X 
(c) X- 3A +2B=O (d) 6X — 4A - 3B = O 
14. Solve for X in the equation, given 


-2 -1 0 3 
A=| ı o| and B=| 2 ol 
3-4 -4 -1 


(a) X = 3A — 2B 
(c) 2X+3A4=B 


(b) 2X =2A—-B 
(d) 2A + 4B = -2X 


Operations with Matrices In Exercises 15-22, 


perform the operations, given c = —2 and 

1 2 3 1 3 0 1 
ashi 1 abesla apeli A 
15. c(BA) 16. c(CB) 
17. B(CA) 18. C(BC) 
19. (B+ OA 20. B(C + O) 


21. cB(C + C) 22. B(cA) 


Associativity of Matrix Multiplication In Exercises 23 
and 24, find the matrix product ABC by (a) grouping 
the factors as (AB)C, and (b) grouping the factors as 
A(BC). Show that you obtain the same result from 
both processes. 


1 2 ô i 3 0 
a=] Tsi J c=[% 


-4 2 1 -5 0 
mahi 3h =la 3 1 


-3 4 
c=| 0 ı 
-1 1 


Noncommutativity of Matrix Multiplication In 
Exercises 25 and 26, show that AB and BA are not equal 
for the given matrices. 


=2 1 4 0 
se tL a-|_5 3 


jl 


Equal Matrix Products In Exercises 27 and 28, show 
that AC = BC, even though A # B. 


0 1 1 0 2 3 
mah basf of cal d 


Nie a a 
Nie P= 


za =| 


1 2 3 4 -6 3 
28. A =| 0 5 4), B= 4 4}, 
3 =2 1 =I 0 1 
0 0 0 
C= |0 0 0 
4 -2 3 


Zero Matrix Product In Exercises 29 and 30, show that 
AB = O, even though A + O and B # O. 


3 3 1 ==] 
2.a =l 7 and =|} Al 


2 4 1 -2 
30.4 =|) ‘l and s=| z] 


Operations with Matrices In Exercises 31-36, 
perform the operations when 


aslo -il 


31. IA 32. AI 
33. AU + A) 34. A+ IA 
35. A? 36. A* 
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Writing In Exercises 37 and 38, explain why the 
formula is not valid for matrices. Illustrate your 
argument with examples. 


37. (A + B)(A — B) = A? — R? 
38. (A + B)(A + B) = A? + 2AB + B? 


Finding the Transpose of a Matrix In Exercises 39 
and 40, find the transpose of the matrix. 


I =2 6 =7 19 
39. D=|-3 4 40. D=|-7 0 23 
a: =] 19 23 =32 


Finding the Transpose of a Product of Two Matrices 
In Exercises 41-44, verify that (AB)? = BTAT. 


=3 0 
a. a=|~) l z and B=| 1 2 
2 0 1 
1 =f 
1 3 -1 
aao z| and B=| 2 i 
2 
2 3 1 
43. A= 0 1] and B=(5 4 | 
—2 
2 t =1 1 0 -1 
44. A=]|0 1 3 and B=]|2 t =2 
4 0 2 0 di 3 


Multiplication with the Transpose of a Matrix 
In Exercises 45-48, find (a) ATA and (b) AA’. Show that 
each of these products is symmetric. 


I =] 
asa =le f | 46.A=|3 4 
0 -2 
0 -4 3 2 
$8 4 0 4 
@ 47. 4= se 4 
0 0 -3 2 
4 =3 2 0 
> 0 1 =1 
© 43. 4 = = <2 0 3 
i4 =2 12 =9 
6 8 -5 4 


Finding a Power of a Matrix In Exercises 49-52, find 
the power of A for the matrix 


1 0 0 0 0 

0 -1 0 0 0 
A=1|0 0 1 0 0}. 

0 0 0 -1 0 

0 0 0 0 1 
49, Ale 50. A!’ 
51. A? 52. A% 


Finding an nth Root of a Matrix In Exercises 53 
and 54, find the nth root of the matrix B. An nth root of 
a matrix B is a matrix A such that A” = B. 


0 4 

8 0 0 
54.B=]0 -1 0j n=3 

0 0 27 


True or False? In Exercises 55 and 56, determine 
whether each statement is true or false. If a statement 
is true, give a reason or cite an appropriate statement 
from the text. If a statement is false, provide an example 
that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


55. (a) Matrix addition is commutative. 


(b) The transpose of the product of two matrices equals 
the product of their transposes; that is, (AB)” = A™B’. 


(c) For any matrix C the matrix CC? is symmetric. 
56. (a) Matrix multiplication is commutative. 
(b) If the matrices A, B, and C satisfy AB = AC, then 
B=C. 
(c) The transpose of the sum of two matrices equals the 
sum of their transposes. 


57. Consider the matrices below. 


1 1 2 1 
X=/0), Y= ]1)], Z=/-1], w=)1 
1 0 3 1 


(a) Find scalars a and b such that Z = aX + bY. 


(b) Show that there do not exist scalars a and b such 
that W = aX + bY. 


(c) Show thatifaX + bY + cW = O,thena = 0, b = 0, 
and c = 0. 


(d) Find scalars a, b, and c, not all equal to zero, such 
that aX + bY + cZ = O. 


58. CAPSTONE In the matrix equation 
aX + A(bB) = b(AB + IB) 


X, A, B, and I are square matrices, and a and b are 
nonzero scalars. Justify each step in the solution 
below. 


aX + (Ab)B = b(AB + B) 
aX + bAB = bAB + bB 


aX + bAB + (—bAB) = bAB + bB + (—bAB) 
aX = bAB + bB + (—bAB) 
aX = bAB + (—bAB) + bB 


aX = bB 


x= 22 
a 
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Polynomial Function In Exercises 59 and 60, find f(A) 
using the definition below. 

If f(x) = ay + ax + a,x? ++ + + + a,x" is a polynomial 
function, then for a square matrix A, 

f(A) = aI + aA + aA? +: ota A". 


59, f(x) = 2 — 5x +22, a-i; s] 


4 5 
1 =1 
60. f(x) = —10 + 5x — 2x7 +3, A = 1 0 
=] 1 3 


61. Guided Proof Prove the associative property of 
matrix addition: A + (B + C) = (A + B) + C. 


Getting Started: To prove that A + (B + C) and 
(A + B) + C are equal, show that their corresponding 
entries are equal. 


(i) Begin your proof by letting A, B, and C be m x n 
matrices. 


(ii) Observe that the ijth entry of B + C is b; + c; 

Gii) Furthermore, the ijth entry of A + (B + C) is 
a, + (b; + cy). 

Gv) Determine the ijth entry of (A + B) + C. 


62. Proof Prove the associative property of multiplication: 
(cd)A + c(dA). 


63. Proof Prove that the scalar | is the identity for scalar 
multiplication: 1A = A. 


64. Proof Prove the distributive property: 
(c + dA = cA + dA. 
65. Proof Prove Theorem 2.2. 
66. Proof Complete the proof of Theorem 2.3. 
(a) Prove the associative property of multiplication: 
A(BC) = (AB)C. 
(b) Prove the distributive property: 
(A + B)C = AC + BC. 
(c) Prove the property: 
c(AB) = (cA)B = A(cB). 
67. Proof Prove Theorem 2.4. 
68. Proof Prove Properties 2, 3, and 4 of Theorem 2.6. 


69. Guided Proof Prove that if A is an m x n matrix, 
then AA’ and ATA are symmetric matrices. 
Getting Started: To prove that AAT is symmetric, you need 
to show that it is equal to its transpose, (AAT) = AA’. 
(i) Begin your proof with the left-hand matrix 
expression (AA™)?. 
(ii) Use the properties of the transpose operation 
to show that (AA’)’ can be simplified to equal the 
right-hand expression, AA’. 


(iii) Repeat this analysis for the product A7A. 


2.2 Exercises 61 


70. Proof Let A and B be twon x n symmetric matrices. 
(a) Give an example to show that the product AB is not 
necessarily symmetric. 


(b) Prove that the product AB is symmetric if and only 
if AB = BA. 


Symmetric and Skew-Symmetric Matrices In 
Exercises 71-74, determine whether the matrix is 
symmetric, skew-symmetric, or neither. A square matrix 


is skew-symmetric when A? = —A. 
0 2 2 1 
masl o] niai ] 
0 2 4 0 2 -1 
73,.A4=|2 0 3| 74A=/-2 0 -3 
1 3 0 1 3 0 


75. Proof Prove that the main diagonal of a skew- 
symmetric matrix consists entirely of zeros. 


76. Proof Prove that if A and B are n x n skew-symmetric 
matrices, then A + B is skew-symmetric. 


77. Proof Let A be a square matrix of order n. 
(a) Show that (A + A’) is symmetric. 
(b) Show that (A — A’) is skew-symmetric. 
(c) Prove that A can be written as the sum of a 


symmetric matrix B and a skew-symmetric matrix C, 
A=B+C. 


(d) Write the matrix below as the sum of a symmetric 
matrix and a skew-symmetric matrix. 


2 5 3 
A=]|=3 6 0 
+ 1 1 


78. Proof Prove that if A is ann x n matrix, then A — AT 
is skew-symmetric. 


f> 79. Consider matrices of the form 


O ay az... ain 
0 0 az ... A, 
A=]: 
0 0 O sra Diin 
0 0 O 224 0 


(a) Write a2 x 2 matrix and a 3 x 3 matrix in the form 
of A. 


(b) Use a graphing utility to raise each of the matrices 
to higher powers. Describe the result. 

(c) Use the result of part (b) to make a conjecture 
about powers of A when A is a 4 x 4 matrix. Use a 
graphing utility to test your conjecture. 

(d) Use the results of parts (b) and (c) to make a 
conjecture about powers of A when A is an 
n x n matrix. 
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2.3 The Inverse of a Matrix 


il Find the inverse of a matrix (if it exists). 
P| Use properties of inverse matrices. 
| Use an inverse matrix to solve a system of linear equations. 


MATRICES AND THEIR INVERSES 


Section 2.2 discussed some of the similarities between the algebra of real numbers and 
the algebra of matrices. This section further develops the algebra of matrices to include 
the solutions of matrix equations involving matrix multiplication. To begin, consider 
the real number equation ax = b. To solve this equation for x, multiply both sides of 
the equation by a~! (provided a + 0). 


ax = b 
(a~'a)x = a~'b 
(1)x = a™!b 
x=a!b 


The number a`! is the multiplicative inverse of a because a~'a = 1 (the identity 
element for multiplication). The definition of the multiplicative inverse of a matrix is 
similar. 


Definition of the Inverse of a Matrix 


An n x n matrix A is invertible (or nonsingular) when there exists an n x n 
matrix B such that 


AB = BA = I, 


where Z, is the identity matrix of order n. The matrix B is the (multiplicative) 
inverse of A. A matrix that does not have an inverse is noninvertible (or 
singular). 


Nonsquare matrices do not have inverses. To see this, note that if A is of size 
m x n and B is of size n x m (where m + n), then the products AB and BA are of 
different sizes and cannot be equal to each other. Not all square matrices have inverses. 
(See Example 4.) The next theorem, however, states that if a matrix does have an 
inverse, then that inverse is unique. 


THEOREM 2.7 Uniqueness of an Inverse Matrix 


If A is an invertible matrix, then its inverse is unique. The inverse of A is 
denoted by A7!. 


PROOF 
If A is invertible, then it has at least one inverse B such that 
AB = I = BA. 


Assume that A has another inverse C such that 
AC = I = CA. 


Demonstrate that B and C are equal, as shown on the next page. 
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REMARK 


Recall that it is not always true 
that AB = BA, even when both 
products are defined. If A and 
B are both square matrices and 
AB = l, however, then it can 
be shown that BA = /,. (The 
proof of this is omitted.) So, 

in Example 1, you need only 
check that AB = lh. 
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AB=I 
C(AB) = CI 
(CA)B =C 
IB = C 
B=C 
Consequently B = C, and it follows that the inverse of a matrix is unique. i 


The inverse A~! of an invertible matrix A is unique, so you can call it the inverse 
of A and write AA™! = ATIA = I. 


SOEI The Inverse of a Matrix 


Show that B is the inverse of A, where 


-1 2 1 -2 
a= | and B=|) ak 


SOLUTION 


Using the definition of an inverse matrix, show that B is the inverse of A by showing 


that AB = I = BA. 
To "| 
224 0 1 


=f ot =2 -i +2 
aB=| i alle a ee 
i =8-i- 2 =e 3-9 1 0 
Ba =| The ally Ree ilh i al 


The next example shows how to use a system of equations to find the inverse of 
a matrix. 


EXAMPLE 2 Finding the Inverse of a Matrix 


Find the inverse of the matrix 


a[i -al 


SOLUTION 


To find the inverse of A, solve the matrix equation AX = J for X. 
| 1 Jo =) i l; "| 
—1 -3]L%1 Xo 0 1 
| xu + 4%, Xia + “d = l "| 
=x — 3X, 0 1 


xy, T 3Xqy 
Equating corresponding entries, you obtain two systems of linear equations. 


Xa + 4x,, = 1 
—x,, — 3x), =0 


Xi + 4x,. = 0 
=x — 3%, = 1 


Solving the first system, you find that x,, = —3 and x,, = 1. Similarly, solving the 


second system, you find that x,, = —4 and x», = 1. So, the inverse of A is 
=3 =4 
X=Al= ; 
[i 
Use matrix multiplication to check this result. i 
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Generalizing the method used to solve Example 2 provides a convenient method 
for finding an inverse. Note that the two systems of linear equations 


xu + 4x, =1 Xo + 4x, = 0 
Xii — 3x), = 0 X19 — 3X = 1 


have the same coefficient matrix. Rather than solve the two systems represented by 
| 1 4 4 and | 1 4 J 
=] =3 0 =] =3 1 


separately, solve them simultaneously by adjoining the identity matrix to the coeficient 
matrix to obtain 


| 1 4 1 "| 

=). =3 0 1} 

By applying Gauss-Jordan elimination to this matrix, solve both systems with a single 
elimination process, as shown below. 


| 4 ı "| 

O 1l ae R, + R, OR, 

f 0 -3 =| R, + (-4)R, >R, 
O 1 1 1 


Applying Gauss-Jordan elimination to the “doubly augmented” matrix [A I], you 
obtain the matrix [7 A7']. 


i 4 4 0 1 0 -3 =4 
e 0 | > I 1 1 i 


A I I AmI 


This procedure (or algorithm) works for an arbitrary n x n matrix. If A cannot be row 
reduced to J,, then A is noninvertible (or singular). This procedure will be formally 


justified in the next section, after introducing the concept of an elementary matrix. For 
now, a summary of the algorithm is shown below. 


Finding the Inverse of a Matrix by Gauss-Jordan Elimination 


Let A be a square matrix of order n. 


1. Write the n x 2n matrix that consists of A on the left and the n x n identity 
matrix J on the right to obtain [A 7]. This process is called adjoining 
matrix / to matrix A. 

. If possible, row reduce A to 7 using elementary row operations on the entire 
matrix [A J]. The result will be the matrix [7 A7!]. If this is not 
possible, then A is noninvertible (or singular). 

. Check your work by multiplying to see that AA~! = J = A7!A, 


LINEAR Recall Hooke’s law, which states that for relatively small 
ALGEBRA deformations of an elastic object, the amount of deflection is 
directly proportional to the force causing the deformation. In 
APPLIED a simply supported elastic beam subjected to multiple forces, 
deflection d is related to force w by the matrix equation 
d= Fw 


where F is a flexibility matrix whose entries depend on the 
material of the beam. The inverse of the flexibility matrix, 
F~', is the stiffness matrix. In Exercises 61 and 62, you are 
asked to find the stiffness matrix F~' and the force matrix w 
for a given set of flexibility and deflection matrices. 


nostal6ie/Shutterstock.com 
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EXAMPLE 3 Finding the Inverse of a Matrix 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


Find the inverse of the matrix. 


| =] 0 

A= 1 0 =] 

—6 2 3 
SOLUTION 


Begin by adjoining the identity matrix to A to form the matrix 


1-1 0 1 0 0 
[A A=! 1 0-1 0 ı OL 
-6 2 3 0 0 1 


Use elementary row operations to obtain the form 
U Av’ 


as shown below. 


0 1-1 -1 1 0 R, + (-DR, >R, 


The Technology Guide at 
CengageBrain.com can help 
you use technology to find 
the inverse of a matrix. 


0 -2 -3 -1 R, + R >R; 
0 -3 -3 -1 
0 0 1 -2 -4 -1 


1 =] 0 1 0 0 
f 1 -1 =] 1 o 
0 —4 3 6 0 1 R, + (6)R, OR; 
1 =l 0 1 0 0 
f 1-1 =1 1 o 
TI V 0 0 -1 2 4 1 R, + (4)R, >R, 
Many graphing utilities and 1 =l 0 1 0 0 
software programs can 0 i = =1 1 0 
find the inverse of a square f 0 i =< tå = } (-DR,SR, 
matrix. When you use a ; 
graphing utility, you may 1 = 0 1 0 0 
see something similar to the o 0 =3 =3 = i R, + R>R, 
screen below for Example 3. 0 


The matrix A is invertible, and its inverse is 


-2 -3 -1 
A =|-3 -3 ~il. 
-2 -4 -1 


Confirm this by showing that 
AAT“! =] = A'A. Lu 


The process shown in Example 3 applies to any n x n matrix A and will find the 
inverse of A, if it exists. When A has no inverse, the process will also tell you that. The 
next example applies the process to a singular matrix (one that has no inverse). 
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i EXAMPLE 4 A Singular Matrix 


Show that the matrix has no inverse. 


1 2 0 
A= 3 =l 2 
=2 3. =2 


SOLUTION 


Adjoin the identity matrix to A to form 


1 2 0 1 0 0 
[A =| 3 -1 2 0 1 0 
= 322 © O i 


and apply Gauss-Jordan elimination to obtain 


1 2 0 1 0 0 
0 =7 2 =3 1 0}. 
0 0 0 =l 1 1 


Note that the “A portion” of the matrix has a row of zeros. So it is not possible to 
rewrite the matrix[A J]intheform[J A7~']. This means that A has no inverse, or is 
noninvertible (or singular). | 


Using Gauss-Jordan elimination to find the inverse of a matrix works well (even 
as a computer technique) for matrices of size 3 x 3 or greater. For 2 x 2 matrices, 
however, you can use a formula for the inverse rather than Gauss-Jordan elimination. 

If A is a2 x 2 matrix 


_|fa b 
REMARK ss 2 


The denominator ad — bc is NA TAES i : 
called the determinant of A. then A is invertible if and only if ad — bc # 0. Moreover, if ad — bc # 0, then the 


You will study determinants inverse is 
in detail in Chapter 3. j [ d =] 


Sf o 


~ ad — bc 


EXAMPLE 5 Finding Inverses of 2 x 2 Matrices 


If possible, find the inverse of each matrix. 


3 =l 33, =l 
a 2] a 
SOLUTION 


a. For the matrix A, apply the formula for the inverse of a 2 x 2 matrix to obtain 
ad — bc = (3)(2) — (—1)(—2) = 4. This quantity is not zero, so A is invertible. 
Form the inverse by interchanging the entries on the main diagonal, changing the 
signs of the other two entries, and multiplying by the scalar L as shown below. 


| 


b. For the matrix B, you have ad — bc = (3)(2) — (—1)(—6) = 0, which means that 
B is noninvertible. u 


c a 


BI RIS 
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PROPERTIES OF INVERSES 


Theorem 2.8 below lists important properties of inverse matrices. 


THEOREM 2.8 Properties of Inverse Matrices 


If A is an invertible matrix, k is a positive integer, and c is a nonzero scalar, then 
A7!, A‘, cA, and A? are invertible and the statements below are true. 
1. (A!) =A 2. (A)! =A NA! At = (Aa) 
ey 
k factors 


3. (cat = 4, (AD = (A71) 


PROOF 


The key to the proofs of Properties 1, 3, and 4 is the fact that the inverse of a matrix is 
unique (Theorem 2.7). That is, if BC = CB = J, then C is the inverse of B. 

Property 1 states that the inverse of A`! is A itself. To prove this, observe that 
A~!A = AA~! = I, which means that A is the inverse of A~!. Thus, A = (A7!)7!. 


1 
Similarly, Property 3 states that —A~! is the inverse of (cA), c # 0. To prove this, 
č 


use the properties of scalar multiplication given in Theorems 2.1 and 2.3. 


(eay(4a-*) = (Eja =i =1 
(Ha) - (te)a-ta =(I=1 


1 1 
So —A~! is the inverse of (cA), which implies that (cA)~! = —A7!. Properties 2 and 4 
c c 


are left for you to prove. (See Exercises 63 and 64.) 


For nonsingular matrices, the exponential notation used for repeated multiplication 
of square matrices can be extended to include exponents that are negative integers. This 
may be done by defining A“ to be 


ATK =A 'A7!.- a A! = (A7!), 
k factors 


Using this convention you can show that the properties A/A* = A/** and (A/)* = AF are 
true for any integers j and k. 


DISCOVERY 


1 2 2 =l 
Leta =|, 3] and B-|° “th 


Í. Find (AB)-, A~'B~, and B-1A“, 


2. Make a conjecture about the inverse of a product of two nonsingular 
matrices. Then select two other nonsingular matrices of the same 
order and see whether your conjecture holds. 


See LarsonLinearAlgebra.com for an interactive version of this type of exercise. 
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Chapter 2 Matrices 


EXAMPLE 6 | The Inverse of the Square of a Matrix 


Compute A~? two different ways and show that the results are equal. 


SOLUTION 
One way to find A~? is to find (A?)~! by squaring the matrix A to obtain 


ma h a 
and using the formula for the inverse of a 2 x 2 matrix to obtain 
(42-1 -{ 18 E -| 2 E 
4—10 3 - f 
Another way to find A~? is to find (A7 1}? by finding A~! 
ai= 4 i-i 2 i 
A= 1 -1 3 


and then squaring this matrix to obtain 


Note that both methods produce the same result. ui 


The next theorem gives a formula for computing the inverse of a product of 
two matrices. 


THEOREM 2.9 The Inverse of a Product 


If A and B are invertible matrices of order n, then AB is invertible and 


(AB)! = B'A !, 


PROOF 
To show that B~'A~' is the inverse of AB, you need only show that it conforms to the 
definition of an inverse matrix. That is, 
(4B)(B-'A-!) = A(BB~)A-! = A(DAW! = (ADA! = AAW! = 1. 
In a similar way, (B~'A~!)(AB) = I. So, AB is invertible and its inverse is B~!A7!. 


P| 


Theorem 2.9 states that the inverse of a product of two invertible matrices is the 
product of their inverses taken in the reverse order. This can be generalized to include 
the product of more than two invertible matrices: 


(A,A,A, ` ` Ay =A, t ay Az HAT.. 


(See Example 4 in Appendix.) 
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EXAMPLE 7 Finding the Inverse of a Matrix Product 


Find (AB) ~! for the matrices 


1 3 3 1 2 3 
A=)1 4 3] and B=/1 3 3 
1 3 4 2, 4 3 
using the fact that A~! and B~! are 
T 23 23 1 -2 1 
REMARK A'=|]-1 1 O| and B'=]-1 1 ol 
Note that you reverse the order =1 0 1 z 0 -4 
of multiplication to find the 
inverse of AB. That is, 
(AB)! = B-1A~, and the SOLUTION 
inverse of AB is usually not Using Theorem 2.9 produces 
equal to A™'B™1. 
(AB) = B-'A7! 
1 -2 1 T 3 3 
=|-1 1 ol —1 1 0 
2 1 
3 0 ==] 0 1 
8 -5 —-2 
=|-8 4 3 |. 
2p =l Lad 


One important property in the algebra of real numbers is the cancellation property. 
That is, if ac = be (c + 0), then a = b. Invertible matrices have similar cancellation 
properties. 


THEOREM 2.10 Cancellation Properties 


If C is an invertible matrix, then the properties below are true. 


1. If AC = BC, then A = B. Right cancellation property 
2. If CA = CB, then A = B. Left cancellation property 


PROOF 
To prove Property 1, use the fact that C is invertible and write 
AC = BC 
(AC)C~! = (BC)C™! 
A(CC"!) = B(CC“!) 


Al = BI 
A=B. 
The second property can be proved in a similar way. (See Exercise 65.) m 


Be sure to remember that Theorem 2.10 can be applied only when C is an 
invertible matrix. If C is not invertible, then cancellation is not usually valid. For 
instance, Example 5 in Section 2.2 gives an example of a matrix equation AC = BC 
in which A # B, because C is not invertible in the example. 
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Chapter 2 Matrices 


SYSTEMS OF EQUATIONS 


For square systems of equations (those having the same number of equations as variables), 
you can use the theorem below to determine whether the system has a unique solution. 


THEOREM 2.11 Systems of Equations with Unique Solutions 


If A is an invertible matrix, then the system of linear equations Ax = b has a 
unique solution x = A` !b. 


PROOF 
The matrix A is nonsingular, so the steps shown below are valid. 
Ax =b 
A-'Ax = A7'b 
Ix = A~'b 
x=A'b 


This solution is unique because if x, and x, were two solutions, then you could apply 
the cancellation property to the equation Ax, = b = Ax, to conclude that x, = x;. J 


One use of Theorem 2.11 is in solving several systems that all have the same 
coefficient matrix A. You could find the inverse matrix once and then solve each 
system by computing the product A~'b. 


e] Solving Systems of Equations 
EXAMPLE 8 Using an Inverse Matrix 
Use an inverse matrix to solve each system. 


a. 2x +3y+z=-1 b. 2x + 3y+z=4 ec 2x + 3y+z=0 


3x +3y+z= 1 3x + 3y+z=8 3x + 3y +z=0 
2x+4y+z=-2 2x+4y+z=5 2x+4y+z=0 
SOLUTION 
2 3 
First note that the coefficient matrix for each system is A = | 3 3 
2 4 
=] 1 0 
Using Gauss-Jordan elimination, A~! = | — 1 0 1}. 
6 =2 =3 
=] 1 ol — 2 ae 
i ee Ap =| 24 0 I = || The solution is x = 2, 
6 2 3 2 y = —l,andz= —2. 
=] 1 0 || 4 4 a 
b. x = Ab =|-1 0 i\ls|= 1 The solution is x = 4, 
6 -2 -3l5 -7 y= l, andz = —7. 
=I 1 olo 0 ARSE TO 
ce x=A-b=]|-1 0 1llol=lo The solution is trivial: 
6 -2 310 0 x =0,y = 0, and z = 0. 
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2.3 Exercises 


The Inverse of a Matrix In Exercises 1-6, show that B 
is the inverse of A. 


2 1 3 1 
a=; sb 2s l-3 A 


WwW = | 
= 
e N | 
L—l 
m Ne 
L—— 
le] 
II & 
| — 
WIN WB wie N we pp 
l 
= = =e = 
E— h 


2-17 11 1 2 
6.A=|-1 11 -7|, B= 4 -3 
0 3 =2 6 =5 


Finding the Inverse of a Matrix In Exercises 7-30, 


find the inverse of the matrix (if it exists). 


s[i a 


1 2 
ss 3 w, 23 
-7 33 1 1 
n. | 2 12. |- 3 4 
1 1 1 i 2 2 
13. |3 5 4 14. 3 7 9 
3 6 5 -1 -4 - 
1 2-1 5 - 
15./3 7—10 16. 2 1 4 
7 16-21 3 2 - 
i 1 2 3 2 5 
17.) 3 1 0 18.) 2 2 4 
-2 0 3 -4 4 0 
_5 L u 
2 0 0 6 3 6 
19.0 3 0 2. 0 4 2 
0 0 5 1l $ 
2 2 
06 0 -03 01 02 03 
21.0.7 -1 02| 22 E - 0.2 
1 0 -09 0.5 
0 0 
23.3 4 0 24. 
2 5 5 


See CalcChat.com for worked-out solutions to odd-numbered exercises. 


0 27. 


O 29. 


2.3 Exercises 


SE 


=% 0 0 0 1 0 0 0 
0 1 0 0 0 2 0 0 
= 0 0 0 0 = 0 0 =2 0 
0 0 0 =5 0 0 0 3 
1. =2) =] =2 4 8 -7 14 

3 -= 2 3 2 5 —4 6 
2 Sr S2 5 Oz. 0 2 L -=7 
=1 4 4 ll 3 6 =5 10 
1 0 3 0 1 3° -=2 0 
0 2 0 4 0 2 4 6 
1 0 3 0 ©». 0 0 =2 1 
0 2 0 4 0 0 0 5 


Finding the Inverse of a 2 x 2 Matrix In Exercises 
31-36, use the formula on page 66 to find the inverse of 
the 2 x 2 matrix (if it exists). 


2 3 1 -2 
mE ;| 32. E | 
-4 -6 -12 3 
a S] wf | 


L 3 

2 4 
35. | ] 

5 5 


Finding the Inverse of the Square of a Matrix 
In Exercises 37-40, compute A~? two different ways and 
show that the results are equal. 


37. a=| 3 =] 38. A=| 2 | 


1 3 5 6 
=2 0 0 6 0 4 
39 A=] 0 1 0 40. A =| -2 T =l 
0 0 3 3 1 2 


Finding the Inverses of Products and Transposes 
In Exercises 41-44, use the inverse matrices to find 
(a) (AB)~1, (b) (A7)~, and (c) (2A)7?. 


2 5 T =3 
-1 = -1 = 
aiie 3) =|? 3] 


— l 5 2 
= é i = 11 11 

aft i oei 4 

7 7 11 11 

L- 3 EE 
43.a =|} 3 -2| B =|-ł4 2 | 

1 1 1 1 

4 l 3 4 2 2 

1-4 2 6 5 = 
44. a =o 1 3), B =|-2 4 -1 

4 2 1 i 3 
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Solving a System of Equations Using an Inverse 
In Exercises 45-48, use an inverse matrix to solve each 
system of linear equations. 


45. (a) x + 2y=-1 46. (a) 2x — y = -3 


Singular Matrix In Exercises 55 and 56, find x such 
that the matrix is singular. 
x 2 
56. A = 
Am a 


4 x 
55. A = E | 


ae a ae a Solving a Matrix Equation In Exercises 57 and 58, 
(b) x + 2y = 10 (b) 2x -y=-1 find A. 

x — 2y = —6 ae are ft 2 r 2 4 

47. (a) x, + 2x,+x,= 2 57. (2A) ' = p A 58. (44)! = E 3| 

xi +2x,-—x,= 4 

x, — 2x, + x = -2 Finding the Inverse of a Matrix In Exercises 59 
(b) x, + 2x,+%,= 1 and 60, show that the matrix is invertible and find its 

utn -n= 3 inverse. l 

PEE EE 59.4 =| sin 0 a pan [ee ne 

—cos@ sind tan@ sec @ 


48. (a) x, + x,» -—2x,= O 

% 72% + = 0 Beam Deflection In Exercises 61 and 62, forces w,, W, 
and w, (in pounds) act on a simply supported elastic 
beam, resulting in deflections d,, d,, and d, (in inches) in 
the beam (see figure). 


= Kye =l 

(b) x, + x, — 2x,=—-1 

xX, —2xX,+ x, = 2 

Xy—- nr= x= 0 
BE solving a System of Equations Using an Inverse 
Q In Exercises 49-52, use a software program or a 
= graphing utility to solve the system of linear equations 

using an inverse matrix. 


49. x, +2x,- x, + 3x,-—x, = —3 
x, — 3%) + x4 + 2x, x = -3 Use the matrix equation d = Fw, where 
2x, + xX, + x3 - 3x, +x, = 6 d, Wy 
x — antytt xy-— Xs 2 d=|d,|, w=], 
2x, + g= x, + 2x, + x, = —3 d, W3 
50. x) txa x + 34y 3 and F is the 3 x 3 flexibility matrix for the beam, to find 
2x, +x + xt xy tx = 4 the stiffness matrix F7! and the force matrix w. The 
nte = atiy- 3 entries of F are measured in inches per pound. 
2x, + hy + Any + Ky = x=] 0.008 0.004 0.003 0.585 
e eg = Ea eg 61. F =| 0.004 0.006 0.004], d =| 0.640 
SL 2x, — 3x, + x, -—2x,+ x; -4x = 20 0.003 0.004 0.008 0.835 
3X, + x= 4x ag Xs + Oe = 16 0.017 0.010 0.008 0 
Ax, + xy = 3x3 + 4x4 = xs + 2x5 = — 12 62. F=|0.010 0.012 0.010], a= [0.15 
—5x, — x + 4x, + 2x, — 5x; + 3x5 = -2 0.008 0.010 0.017 0 
X, + o= 3x, + 4x, -— 3x, + x, = —15 
3x = Kg t 2x = 3x + 2x = 6r = 25 63. Proof Prove Property 2 of Theorem 2.8: If A is an 
E ET E SE — de = 1 invertible matrix and k is a positive integer, then 
3x, + 6x, = 5x, — 6x, + 3x5 + 3x, = —11 (AX)-! = AT!AT! - - - AT! = (A) 
2X, — 3X, + X34+3x,- g= 2a 0 —— 
—x, + 4x, — 4x, — 6x, + 2x5 + 4x, = -9 k factors 
3X, = xX» + 5x3 + 2x4 = 3x5 = 3x5 = 1 64. Proof Prove Property 4 of Theorem 2.8: If A is an 


—2x, + 3x, — 4x, — 6x4 + x5 + 2x = —12 invertible matrix, then (AT)! = (A7!)?. 
Matrix Equal to Its Own Inverse In Exercises 53 and 65. Proof Prove Property 2 of bees 2.10: B C is an 
54, find x such that the matrix is equal to its own inverse. invertible matrix such that CA = CB, then A = B. 

3 x 2 a 66. Proof Prove that if A? = A, then 
ae | 


Sael 
=I =2 I— 2A = (I — 2A)! 
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67. Guided Proof Prove that the inverse of a symmetric 
nonsingular matrix is symmetric. 


Getting Started: To prove that the inverse of A is 
symmetric, you need to show that (A~!)7? = A7!. 
(i) Let A be a symmetric, nonsingular matrix. 
(ii) This means that A? = A and A`! exists. 
(iii) Use the properties of the transpose to show that 
(A~!)? is equal to A~!. 
68. Proof Prove that if A, B, and C are square matrices 
and ABC = IJ, then B is invertible and B~! = CA. 
69. Proof Prove that if A is invertible and AB = O, 
then B = O. 
70. Guided Proof Prove that if A? = A, then either A is 
singular or A = I. 
Getting Started: You must show that either A is singular 
or A equals the identity matrix. 
(i) Begin your proof by observing that A is either 
singular or nonsingular. 
(ii) If A is singular, then you are done. 


Gii) If A is nonsingular, then use the inverse matrix A~! 
and the hypothesis A? = A to show that A = J. 


True or False? In Exercises 71 and 72, determine 
whether each statement is true or false. If a statement 
is true, give a reason or cite an appropriate statement 
from the text. If a statement is false, provide an example 
that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


71. (a) If the matrices A, B, and C satisfy BA = CA and A 
is invertible, then B = C. 


(b) The inverse of the product of two matrices is the 
product of their inverses; that is, (AB)~! = A~'B7!. 


(c) If A can be row reduced to the identity matrix, then 
A is nonsingular. 


72. (a) The inverse of the inverse of a nonsingular matrix 
A, (A7!)~!, is equal to A itself. 


b 
(b) The matrix |? A isinvertible whenab — dc # 0. 
c 


(c) If A is a square matrix, then the system of linear 
equations Ax = b has a unique solution. 
73. Writing Is the sum of two invertible matrices 
invertible? Explain why or why not. Illustrate your 
conclusion with appropriate examples. 


74. Writing Under what conditions will the diagonal matrix 


ayy 0 Or 2A« 0 
asf O a 0s 0 
0 0 0... a 


nn 


be invertible? Assume that A is invertible and find 
its inverse. 


75 


76. 


77. 


78. 


79. 


80. 


81. 


83. 


2.3 Exercises 73 


. Use the result of Exercise 74 to find A`! for each 
matrix. 
-1 0 0 
(a) A= 0 3 0 
0 0 2 
1 
a 0 0 
bA=|0 4 0 
0 0 | 
1 2 
Let A = . 
ü E | 


(a) Show that A? — 2A + 5I = O, where I is the 
identity matrix of order 2. 

(b) Show that A~! = 4(27 — A). 

(c) Show that for any square matrix satisfying 
A? — 2A + 5I = O, the inverse of A is 
A! = #21 — A). 

Proof Let u be an n x 1 column matrix satisfying 

uu = /,. Then x n matrix H = 1, — 2uu’ is called a 

Householder matrix. 


(a) Prove that H is symmetric and nonsingular. 
J2/2 
(b) Let u = | /2/2]. Show that uu = I, and find the 
0 
Householder matrix H. 


Proof Let A and B ben x n matrices. Prove that if the 
matrix J — AB is nonsingular, then so is Z — BA. 


Let A, D, and P be n x n matrices satisfying AP = PD. 
Assume that P is nonsingular and solve this equation 
for A. Must it be true that A = D? 


Find an example of a singular 2 x 2 matrix satisfying 
A? =A. 


Writing Explain how to determine whether the inverse 
of a matrix exists. If so, explain how to find the inverse. 


82. CAPSTONE As mentioned on page 66, if A 
is a2 x 2 matrix 


then A is invertible if and only if ad — bc # 0. 
Verify that the inverse of A is 


1 d —b 
-1 — 
A zli bl. 


Writing Explain in your own words how to write a 
system of three linear equations in three variables as a 
matrix equation, Ax = b, as well as how to solve the 
system using an inverse matrix. 
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2.4 Elementary Matrices 


i Factor a matrix into a product of elementary matrices. 


Find and use an LU-factorization of a matrix to solve a system 
of linear equations. 


ELEMENTARY MATRICES AND ELEMENTARY 
ROW OPERATIONS 


Section 1.2 introduced the three elementary row operations for matrices listed below. 
1. Interchange two rows. 


2. Multiply a row by a nonzero constant. 


REMARK 3. Add a multiple of a row to another row. 
The identity matrix /,, is 
elementary by this definition In this section, you will see how to use matrix multiplication to perform these operations. 
because it can be obtained 
from itself by multiplying any Definition of an Elementary Matrix 


one of its rows by 1. 


An n x n matrix is an elementary matrix when it can be obtained from the 
identity matrix J, by a single elementary row operation. 


Elementary Matrices and 
EXAMPLE 1 Nonelementary Matrices 


Which of the matrices below are elementary? For those that are, describe the 
corresponding elementary row operation. 


1 0 0 
a. | 0 3 0 b. p A J 
0 0 1 
1 0 0 1 0 0 
c. 1 0 d. | 0 0 1 
0 0 0 1 0 
1 0 0 
e |; "| f. | 0 2 0 
0 0 -1 
SOLUTION 


a. This matrix is elementary. To obtain it from /,, multiply the second row of J, by 3. 

b. This matrix is not elementary because it is not square. 

c. This matrix is not elementary because to obtain it from /,, you must multiply the 
third row of /, by 0 (row multiplication must be by a nonzero constant). 

d. This matrix is elementary. To obtain it from /,, interchange the second and third 
rows of J;. 

e. This matrix is elementary. To obtain it from /,, multiply the first row of J, by 2 and 
add the result to the second row. 

f. This matrix is not elementary because it requires two elementary row operations to 
obtain from J,. 
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REMARK 


Be sure to remember in 
Theorem 2.12 to multiply A 
on the left by the elementary 
matrix E. This text does not 
consider right multiplication 
by elementary matrices, which 
involves column operations. 


2.4 Elementary Matrices 75 


Elementary matrices are useful because they enable you to use matrix multiplication 
to perform elementary row operations, as demonstrated in Example 2. 


FANA] m] Elementary Matrices and 
EXAMPLE 2 Elementary Row Operations 

a. In the matrix product below, E is the elementary matrix in which the first two rows 
of J, are interchanged. 


È A 


0 1 0 || 0 2 1 |- S3 6 
1 0 oji. =3 6| =| 0 2 1 
0 0 13 2, =] 3 2 =i 


Note that the first two rows of A are interchanged when multiplying on the left by E. 


b. In the matrix product below, E is the elementary matrix in which the second row of 
I, is multiplied by 5. 


E A 
1 0 ofi o-4 1 1 0-4 #1 
o 4 olo 2 6 -4/=]0 1 3 -2 
o o alo 1 3 1} [0 1 3 1 


Note that the second row of A is multiplied by ; when multiplying on the left by E. 


c. In the matrix product below, E is the elementary matrix in which 2 times the first 
row of J, is added to the second row. 


E A 


1 0 0 1 0 =I 1 0 =1 
2 1 QO} =2 =2 3;/=|0 -2 1 
0 0 1 0 4 5 0 4 5 


Note that 2 times the first row of A is added to the second row when multiplying on 
the left by E. 


Notice from Example 2(b) that you can use matrix multiplication to perform 
elementary row operations on nonsquare matrices. If the size of A is n x p, then E 
must have order n. 

In each of the three products in Example 2, you are able to perform elementary 
row operations by multiplying on the left by an elementary matrix. The next theorem, 
stated without proof, generalizes this property of elementary matrices. 


THEOREM 2.12 Representing Elementary Row Operations 


Let E be the elementary matrix obtained by performing an elementary row 
operation on 1,. If that same elementary row operation is performed on an m x n 
matrix A, then the resulting matrix is the product FA. 


Most applications of elementary row operations require a sequence of operations. 
For instance, Gaussian elimination usually requires several elementary row operations 
to row reduce a matrix. This translates into multiplication on the left by several 
elementary matrices. The order of multiplication is important; the elementary matrix 
immediately to the left of A corresponds to the row operation performed first. Example 3 
demonstrates this process. 
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REMARK 


The procedure demonstrated 
in Example 3 is primarily of 
theoretical interest. In other 
words, this procedure is 

not a practical method for 
performing Gaussian 
elimination. 


EXAMPLE 3 


Using Elementary Matrices 


Find a sequence of elementary matrices that can be used to write the matrix A in 
row-echelon form. 


A=|1 -3 0 2 
2. =6 2 0 
SOLUTION 
Elementary Row Elementary 
Matrix Operation Matrix 
l =3 0 2 R,OR, 0 1 0 
0 1 3 5 E,=|1 0 0 
2 —-6 2 0 0 0 1 
1 =3 0 2 1 0 0 
0 1 3 5 R, + (—2)R >R; E,=| 0 1 0 
0 0 2 -4 =2 0 1 
1 =3 0 2 1 0 0 
0 1 3 5 E,=)0 1 0 
0 0 1 -2 ()R, > R, 0 0 § 


The three elementary matrices E£}, E,, and E, can be used to perform the same elimination. 


1 0 1 0 ofo 1 ofo 1 3 5 
B=E,EEA=|0 1 Off o 1 olı o Off1 -3 0o 2 
0 o il-2 o ılo o 12-6 2 Oo 
1 0 of 1 o ofi -3 0 2 
=|0 1 Of o 1 olo 1 3 5 
o o il-2 o 1]/2 -6 2 0 
1 0 ofi -3 o 2 1-3 0 2 
=|0 1 Oo 1 3 S/=|o 1 3 5 
o o to o 2- 0 0 1-2 m 


The two matrices in Example 3 


0 1 3 5 
A=|1 -3 0 2| and B=]0 1 3 5 
2 = 2 0 0 0 1 =2 


| 
w 
© 
N 


are row-equivalent because you can obtain B 
operations on A. That is, B = E,E,E,A. 

The definition of row-equivalent matrices is restated below using elementary 
matrices. 


by performing a sequence of row 


Definition of Row Equivalence 


Let A and B be m x n matrices. Matrix B is row-equivalent to A when there 
exists a finite number of elementary matrices E,, E,,. . . , E, such that 


B = EE,- © < BEA. 
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You know from Section 2.3 that not all square matrices are invertible. Every 
elementary matrix, however, is invertible. Moreover, the inverse of an elementary 
matrix is itself an elementary matrix. 


THEOREM 2.13 Elementary Matrices Are Invertible 


If E is an elementary matrix, then E~! exists and is an elementary matrix. 


The inverse of an elementary matrix E is the elementary matrix that converts E 
back to 7,. For instance, the inverses of the three elementary matrices in Example 3 are 
shown below. 


Elementary Matrix Inverse Matrix 
REMARK 0 1 0 ROR, 0 1 0| ROR, 
E>" is as shown because to £,=|1 0 0 Er'=|1 0 0 
convert E, back to /,, in E, you 0 0 1 0 0 1l 
would add 2 times row 1 to 
row 3. 1 0 0 1 0 0 
E=| 0 1 0 Ey'=|0 1 0 
-2 0 1| R +(72)R >R, 2 0 1| R +(2)R >R, 
1 0 0 1 0 0 
E=|0 1 0 E;'=|0 1 0 
0 0 3| RRR, 0 0 2| (R >R, 


Use matrix multiplication to check these results. 
The next theorem states that every invertible matrix can be written as the product 
of elementary matrices. 


THEOREM 2.14 A Property of Invertible Matrices 


A square matrix A is invertible if and only if it can be written as the product of 
elementary matrices. 


PROOF 


The phrase “if and only if” means that there are actually two parts to the theorem. 
On the one hand, you have to show that if A is invertible, then it can be written as the 
product of elementary matrices. Then you have to show that if A can be written as 
the product of elementary matrices, then A is invertible. 

To prove the theorem in one direction, assume A is invertible. From Theorem 
2.11 you know that the system of linear equations represented by Ax = O has only the 
trivial solution. But this implies that the augmented matrix [A O] can be rewritten in 
the form [Z O] (using elementary row operations corresponding to E,, E,,. . ., and 
E,). So, E, + + + E,E,A = I andit follows that A = E;'E,!- - : EJ !. A can be written 
as the product of elementary matrices. 

To prove the theorem in the other direction, assume A is the product of elementary 
matrices. Every elementary matrix is invertible and the product of invertible matrices 
is invertible, so it follows that A is invertible. This completes the proof. | 


Example 4 illustrates the first part of this proof. 
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Writing a Matrix as the Product 
of Elementary Matrices 


~ EXAMPLE 4 


Find a sequence of elementary matrices whose product is the nonsingular matrix 


= 22, 
A= ; 
bal 
SOLUTION 
Begin by finding a sequence of elementary row operations that can be used to rewrite A 


in reduced row-echelon form. 


Matrix Elementary Row Operation 


(-1)R >R; 


Elementary Matrix 
= 0 

E as | 
F d E = | 1 al 
© 2 R, + (-3)R, >R, # L=3 1 


G)R >R, 


R, + (-2)R, >R; r A -2 
$ 0 1 


Now, from the matrix product £,£;E,E,A = I, solve for A to obtain 
A = E,'E,'E,;'E,'. This implies that A is a product of elementary matrices. 


Ey} Ey} Ey! Ey} 


H EEEIEI os 


In Section 2.3, you learned a process for finding the inverse of a nonsingular 
matrix A. There, you used Gauss-Jordan elimination to reduce the augmented matrix 
[A I] to [J A7']. You can now use Theorem 2.14 to justify this procedure. 
Specifically, the proof of Theorem 2.14 allows you to write the product 


I= E, + EEA. 


Multiplying both sides of this equation (on the right) by A~!, A7! = E,- - - E,E,/. In 
other words, a sequence of elementary matrices that reduces A to the identity Z also 
reduces the identity J to A~'. Applying the corresponding sequence of elementary row 
operations to the matrices A and 7 simultaneously, you have 


E, -BEA l= A7]. 


Of course, if A is singular, then no such sequence is possible. 

The next theorem ties together some important relationships between n x n matrices 
and systems of linear equations. The essential parts of this theorem have already been 
proved (see Theorems 2.11 and 2.14); it is left to you to fill in the other parts of the proof. 


THEOREM 2.15 Equivalent Conditions 


If A is ann x n matrix, then the statements below are equivalent. 


. A is invertible. 


. Ax = b has a unique solution for every n x 1 column matrix b. 
. Ax = O has only the trivial solution. 

. A is row-equivalent to /,,. 

. A can be written as the product of elementary matrices. 
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THE LU-FACTORIZATION 


At the heart of the most efficient and modern algorithms for solving linear systems 
Ax = bis the LU-factorization, in which the square matrix A is expressed as a product, 
A = LU. In this product, the square matrix L is lower triangular, which means all the 
entries above the main diagonal are zero. The square matrix U is upper triangular, 
which means all the entries below the main diagonal are zero. 


a1 0 0 4, ah 43 
47, -A 0 0 an az 
a3; Q32 33 0 0 a; 
3 x 3 lower triangular matrix 3 x 3 upper triangular matrix 


Definition of LU-Factorization 


If the n x n matrix A can be written as the product of a lower triangular matrix 
L and an upper triangular matrix U, then A = LU is an LU-factorization of A. 


LU-Factorizations 
“fi alh illo -7 


is an LU-factorization of the matrix 


eli i 


as the product of the lower triangular matrix 


e 


and the upper triangular matrix 


1 -3 0 1 0 ojl — 0 
b. A =| 0 1 3} = |0 1 0}; 0 1 3} = LU 
2 —10 2 2 —4 1|/0 QO 14 
is an LU-factorization of the matrix A. ul 
LINEAR Computational fluid dynamics (CFD) is the computer-based 


ALGEBRA anes of such real-life phenomena as fluid flow, heat 
ansfer, and chemical reactions. Solving the conservation 
APPLIED of energy, mass, and momentum equations involved in a 
CFD analysis can involve large systems of linear equations. 
So, for efficiency in computing, CFD analyses often use 
matrix partitioning and LU-factorization in their algorithms. 
Aerospace companies such as Boeing and Airbus have 
used CFD analysis in aircraft design. For instance, 
engineers at Boeing used CFD analysis to simulate 
airflow around a virtual model of their 787 aircraft to help 
produce a faster and more efficient design than those of 
earlier Boeing aircraft. 


Goncharuk/Shutterstock.com 
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If a square matrix A row reduces to an upper triangular matrix U using only 
the row operation of adding a multiple of one row to another row below it, then it is 
relatively easy to find an LU-factorization of the matrix A. All you need to do is keep 
track of the individual row operations, as shown in the next example. 


EXAMPLE 6 Finding an LU-Factorization of a Matrix 


T =3 0 
Find an LU-factorization of the matrix A = | 0 1 3). 
2 —10 2 


SOLUTION 


Begin by row reducing A to upper triangular form while keeping track of the elementary 
matrices used for each row operation. 


Matrix Elementary Row Operation Elementary Matrix 
1 =3 0 1 0 0 
0 1 3 E,=| 0 1 0 
0 -4 2 R, + (—2)R, >R; -2 0 1 
L =3 0 1 0 0 
0 1 3 E,=1|0 1 0 
0 0 14 R, + (4)R, >R, O 4 1 


The reduced matrix above is an upper triangular matrix U, and it follows that 
E,E,A = U, or A = E,'E,'U. The product of the lower triangular matrices 


1 0 ofi o o f o o 
EE '=|0 ı olo ı oļ=ļo0o ı 0 
2 o iff -4 1] |2 -4 1 


is a lower triangular matrix L, so the factorization A = LU is complete. Notice that this 
is the same LU-factorization as in Example 5(b). 


If A row reduces to an upper triangular matrix U using only the row operation of 
adding a multiple of one row to another row below it, then A has an LU-factorization. 


E,- -E EA=U 
A = ERS. +E = LU 


Here L is the product of the inverses of the elementary matrices used in the row reduction. 

Note that the multipliers in Example 6 are —2 and 4, which are the negatives of 
the corresponding entries in L. This is true in general. If U can be obtained from A 
using only the elementary row operation of adding a multiple of one row to another 
row below it, then the matrix L is lower triangular (with 1|’s along the diagonal), and 
the negative of each multiplier is in the same position as that of the corresponding zero 
in U below the main diagonal. 

Once you have obtained an LU-factorization of a matrix A, you can then solve the 
system of n linear equations in n variables Ax = b very efficiently in two steps. 


1. Write y = Ux and solve Ly = b for y. 
2. Solve Ux = y for x. 


The column matrix x is the solution of the original system because Ax = LUx = Ly = b. 

The second step is just back-substitution, because the matrix U is upper triangular. 
The first step is similar, except that it starts at the top of the matrix, because L is lower 
triangular. For this reason, the first step is often called forward substitution. 
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=< = Solving a Linear System Using 
EXAMPLE 7 LU-Factorization 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


Solve the linear system. 


Xi = 3x3 = =5 
nt 3x, = =1 
2x, — 10x, + 2x, = —20 
SOLUTION 
You obtained an LU-factorization of the coefficient matrix A in Example 6. 
I =3 0 
A= |0 1 3 
2.=10 2 
1 0 oļi -3 0 
=|0 1 0 || 0 1 3 
2 —4 10 0o 14 


First, let y = Ux and solve the system Ly = b for y. 


1 0 oj» =) 
0 1 Olly,| =] -1 
2 -4 1 |y =20 


Solve this system using forward substitution. Starting with the first equation, you have 
yı = —5. The second equation gives y, = — 1. Finally, from the third equation, 
2y, — 4y. + y; = —20 
y3 = —20 — 2y, + 4yy 
y = —20 — 2(—5) + 4(-1) 
y, = —14. 


The solution of Ly = b is 
=) 


y=] -1). 
— 14 


Now solve the system Ux = y for x using back-substitution. 


E =3 0 || x, = 
0 1 3x.) =] —1 
0 0 HMJ; —14 
From the bottom equation, x, = — 1. Then, the second equation gives 


x + 3(-1)=-1 
or x, = 2. Finally, the first equation gives 
x, — 3(2) = -5 


or x, = 1. So, the solution of the original system of equations is 
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2.4 Exercises 


Elementary Matrices In Exercises 1-8, determine 
whether the matrix is elementary. If it is, state the 
elementary row operation used to produce it. 


1 0 
i 2 
1 0 
a 


2 0 0 1 0 0 
5. | 0 0 1 6. | 0 1 0 
0 1 0 2 0 1 
1 0 0 0 
0 1 0 0 
a 0 =5 1 0 
0 0 0 1 
1 0 0 0 
2 1 0 0 
j 0 0 1 0 
0 0 =3 1 


Finding an Elementary Matrix In Exercises 9-12, 
let A, B, and C be 


i 2 -3 -1 2 0 
A=] 0 1 2|, B=] 0 1 2/4, ana 
“i 2 0 1 2 -3 

0 4 -3 
c=] 0 1. 2l. 
-1 2 0 


9. Find an elementary matrix E such that EA = B. 
10. Find an elementary matrix E such that EA = C. 
11. Find an elementary matrix E such that EB = A. 
12. Find an elementary matrix E such that EC = A. 
Finding a Sequence of Elementary Matrices 


In Exercises 13-18, find a sequence of elementary matrices 
that can be used to write the matrix in row-echelon form. 


0 3 -3 6 
13. be i < 14. |1 -1 2 -2 
0 0 2 2 
1 -2 -1 0 1 3 0 
5.| 0 4 8 -4| 16/2 5 -1 
-6 12 8 1 3 -2 -4 
-2 1 0 i -6 0 2 
3 -4 0 0 -3 3 9 
Me) y 2 a eat 4 
-1 2 -2 4 8 -5 1 


Finding the Inverse of an Elementary Matrix 
In Exercises 19-24, find the inverse of the elementary 
matrix. 


0 1 5 0 
w.e 4 » [5 9] 
0 0 1 1 0 0 
21. | 0 1 0 22. | 0 1 0 
1 0 0 0 =3 1 
ia o 1 k 0 
23. | 0 1 0 24 
0 0 1 0 0 1 0 
0 0 0 1 
k#0 


Finding the Inverse of a Matrix In Exercises 25-28, 
find the inverse of the matrix using elementary matrices. 


3 =2 2 0 
s. [3 2] MHG 

1 0 =1 1 0 =2 
27. | 0 6. -=l 28. | 0 2 1 

0 0 4 0 0 1 


Finding a Sequence of Elementary Matrices 
In Exercises 29-36, find a sequence of elementary 
matrices whose product is the given nonsingular matrix. 


1 2 0 1 
ME wf? | 
4 -1 i @ 
afi 4 of | 
1 =2 0 1 2 3 
33.) =1 3 0 34. | 2 5 6 
0 1 1 3 4 
1 0 0 1 4 0 0 2 
0.=1 3 0 0 1 0 1 
= 0 0 2 0 on 0 0 =1 2 
0 0 t -=l 1 0 0 -2 


37. Writing Is the product of two elementary matrices 
always elementary? Explain. 


38. Writing E is the elementary matrix obtained by 
interchanging two rows in /,. A is ann x n matrix. 


(a) How will EA compare with A? (b) Find E?. 
39. Use elementary matrices to find the inverse of 


1 0 0 
A= 1|0 1 0|}, c#0. 
a b C 
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40. Use elementary matrices to find the inverse of 
1 a O}} 1 0 O}] 1 0 

A= /0 1 O||b 1 0/|0 1 0}, 

0 0 1||0 0 1} {0 0 


c #0. 


© 


9 


True or False? In Exercises 41 and 42, determine 
whether each statement is true or false. If a statement 
is true, give a reason or cite an appropriate statement 
from the text. If a statement is false, provide an example 
that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


41. (a) The identity matrix is an elementary matrix. 


(b) If E is an elementary matrix, then 2E is an 
elementary matrix. 

(c) The inverse of an elementary matrix is an 
elementary matrix. 

42. (a) The zero matrix is an elementary matrix. 

(b) A square matrix is nonsingular when it can be 
written as the product of elementary matrices. 

(c) Ax = O has only the trivial solution if and only 
if Ax = b has a unique solution for every n x 1 
column matrix b. 


Finding an LU-Factorization of a Matrix In 
Exercises 43-46, find an LU-factorization of the matrix. 


1 0 =2 1 
a[ > 4 a| 
3 0 2 0 0 
45. 6 1 46.| 0 -3 1 
=3 1 0 10 12 


Solving a Linear System Using LU-Factorization 
In Exercises 47 and 48, use an LU-factorization of the 
coefficient matrix to solve the linear system. 


47. 2x+y = 1 

your= 2 

=x by + z= -2 
48. 2x, = 4 
=2%, F X= = -4 
6x, + 2x, + x, = 15 
=x, = -1 


Idempotent Matrices In Exercises 49-52, determine 
whether the matrix is idempotent. A square matrix A is 
idempotent when A? = A. 


1 0 0 1 
49. | 0 J 50. | 1 | 
0 0 1 0 1 0 
51. | 0 1 0 52. | 1 0 0 
1 0 0 0 0 1 


2.4 Exercises 83 


53. Determine a and b such that A is idempotent. 


1 0 
A= 
lo 
54. Guided Proof Prove that A is idempotent if and only 
if A’ is idempotent. 
Getting Started: The phrase “if and only if’ means that 
you have to prove two statements: 
1. If A is idempotent, then A’ is idempotent. 
2. If A? is idempotent, then A is idempotent. 


(i) Begin your proof of the first statement by assuming 
that A is idempotent. 


(ii) This means that A? = A. 
Gii) Use the properties of the transpose to show that A’ 
is idempotent. 
(iv) Begin your proof of the second statement by 
assuming that A” is idempotent. 
55. Proof Prove that if A is an n x n matrix that is 
idempotent and invertible, then A = [,. 
56. Proof Prove that if A and B are idempotent and 
AB = BA, then AB is idempotent. 


57. Guided Proof Prove that if A is row-equivalent to B 
and B is row-equivalent to C, then A is row-equivalent 
to C. 


Getting Started: To prove that A is row-equivalent to C, 
you have to find elementary matrices FE), E,,. . ., E 
such that A = E,: > + EEC. 
(i) Begin by observing that A is row-equivalent to B 
and B is row-equivalent to C. 
(ii) This means that there exist elementary matrices 
F,F,...,F, and G,,G,...,G,, such that 
A=F,:.-+-F,F,B and B = G,’ © -G,G,C. 
Gii) Combine the matrix equations from step (ii). 
58. Proof Prove that if A is row-equivalent to B, then B is 
row-equivalent to A. 
59. Proof Let A be a nonsingular matrix. Prove that if B 
is row-equivalent to A, then B is also nonsingular. 


. CAPSTONE 
Explain how to find an elementary matrix. 


Explain how to use elementary matrices to find an 
LU-factorization of a matrix. 


Explain how to use LU-factorization to solve a 
linear system. 


61. Show that the matrix below does not have an 
LU-factorization. 
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2.5 Markov Chains 


Use a stochastic matrix to find the nth state matrix of a Markov 
chain. 


Find the steady state matrix of a Markov chain. 


Find the steady state matrix of an absorbing Markov chain. 


STOCHASTIC MATRICES AND MARKOV CHAINS 


Many types of applications involve a finite set of states {S,,55,...,S,} of a 
population. For instance, residents of a city may live downtown or in the suburbs. 
Voters may vote Democrat, Republican, or Independent. Soft drink consumers may buy 
Coca-Cola, Pepsi Cola, or another brand. 

The probability that a member of a population will change from the jth state to the 
ith state is represented by a number p;, where 0 < p; S 1. A probability of p; = 0 
means that the member is certain not to change from the jth state to the ith state, 
whereas a probability of p = 1 means that the member is certain to change from the 
jth state to the ith state. 


From 
gp 
Si Sy Sp 
Pir Pi2 Pin| Si 
p = |P% P2 Pan S2 To 
Pni Pr ESF Pan Sa 


P is called the matrix of transition probabilities because it gives the probabilities of 
each possible type of transition (or change) within the population. 

At each transition, each member in a given state must either stay in that state or 
change to another state. For probabilities, this means that the sum of the entries in any 
column of P is 1. For instance, in the first column, 


Pia t Pa FO eg = 1 


Such a matrix is called stochastic (the term “stochastic” means “regarding 
conjecture”). That is, an n x n matrix P is a stochastic matrix when each entry is a 
number between 0 and | inclusive, and the sum of the entries in each column of P is 1. 


| Examples of Stochastic Matrices 
EXAMPLE 1 and Nonstochastic Matrices 


The matrices in parts (a), (b), and (c) are stochastic, but the matrices in parts (d), (e), 
and (f) are not. 


ce £2 it Ff 
4 5 3 2 
er: i wo 0 & 0.9 08 
a. | 0 1 0 b. ü 
Lo d L 1l 01 0.2 
(0) 0 1 4 3 3 6 
ia L 1 
4 4 3 6 
1 1 1 
1 2 4 3 T ie - F 
a 1 2 ; ; ; ; 
s 3 $ f. 
. ; ' ° ° 3 0.3 04 05 0.6 
4 4 0 04 05 06 07] i 
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Figure 2.1 


REMARK 


Always assume that the matrix 
P of transition probabilities in a 
Markov chain remains constant 
between states. 
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Example 2 describes the use of a stochastic matrix to measure consumer preferences. 


EXAMPLE 2 i A Consumer Preference Model 


Two competing companies offer satellite television service to a city with 100,000 
households. Figure 2.1 shows the changes in satellite subscriptions each year. 
Company A now has 15,000 subscribers and Company B has 20,000 subscribers. How 
many subscribers will each company have in one year? 


SOLUTION 


The matrix of transition probabilities is 


From 
P a 
A B None 


0.70 0.15 0.15] A 
P = | 0.20 0.80 0.15|B To 
0.10 0.05 0.70 | None 


and the initial state matrix representing the portions of the total population in the three 
states is 


0.1500 A 
Xo = | 0.2000 |. B 
0.6500 None 


To find the state matrix representing the portions of the population in the three states in 
one year, multiply P by X, to obtain 


0.70 0.15 0.15][0.1500] [0.2325 
X, = PX, = | 0.20 0.80 0.15 || 0.2000 | = | 0.2875 |. 
0.10 0.05 0.70 || 0.6500| | 0.4800 


In one year, Company A will have 0.2325(100,000) = 23,250 subscribers and 
Company B will have 0.2875(100,000) = 28,750 subscribers. 


A Markov chain, named after Russian mathematician Andrey Andreyevich Markov 
(1856-1922), is a sequence {X,} of state matrices that are related by the equation 
X41, = PX,, where P is a stochastic matrix. For instance, consider the consumer 
preference model discussed in Example 2. To find the state matrix representing the 
portions of the population in each state in three years, repeatedly multiply the initial 
state matrix X, by the matrix of transition probabilities P. 


X, = PX, 
X, = PX, = P+ PX, = PX, 
X, = PX, = P+ PX, = P3X, 


In general, the nth state matrix of a Markov chain is P”Xo, as summarized below. 


nth State Matrix of a Markov Chain 


The nth state matrix of a Markov chain for which P is the matrix of transition 


probabilities and X, is the initial state matrix is 


X, = P'X). 


Example 3 uses the model discussed in Example 2 to demonstrate this process. 
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Chapter 2 Matrices 


EXAMPLE 3 | A Consumer Preference Model 


Assuming the matrix of transition probabilities from Example 2 remains the same year 
after year, find the number of subscribers each satellite television company will have after 
(a) 3 years, (b) 5 years, (c) 10 years, and (d) 15 years. 


SOLUTION 
a. To find the numbers of subscribers after 3 years, first find X}. 
0.3028 A 
X, = P3X_ ~ | 0.3904 B After 3 years 
0.3068 None 


After 3 years, Company A will have about 0.3028(100,000) = 30,280 subscribers 
and Company B will have about 0.3904(100,000) = 39,040 subscribers. 


b. To find the numbers of subscribers after 5 years, first find X5. 


0.3241 A 
X; = PX, ~ | 0.4381 B After 5 years 
0.2378 None 


After 5 years, Company A will have about 0.3241(100,000) = 32,410 subscribers 
and Company B will have about 0.4381(100,000) = 43,810 subscribers. 


c. To find the numbers of subscribers after 10 years, first find X 9. 
0.3329 A 


Xio = PX, ~ | 0.4715 B After 10 years 
0.1957 None 


After 10 years, Company A will have about 0.3329(100,000) = 33,290 subscribers 
and Company B will have about 0.4715(100,000) = 47,150 subscribers. 


d. To find the numbers of subscribers after 15 years, first find X,.. 


0.3333 A 
X15 = PPX, ~ | 0.4756 B After 15 years 
0.1911 None 


After 15 years, Company A will have about 0.3333(100,000) = 33,330 subscribers 
and Company B will have about 0.4756(100,000) = 47,560 subscribers. 


LINEAR Google’s PageRank algorithm makes use of Markov chains. 

ALGEBRA For a search set that contains n web pages, define an n x n 
matrix A such that a;,= 1 when page j references page i 

APPLIED and a,j = 0 otherwise. Adjust A to account for web pages 
without external references, scale each column of Aso 
that A is stochastic, and call this matrix B. Then define 


1= 
n 


M = pB + — PE 


where p is the probability that a user follows a link on a 
page, 1 — p is the probability that the user goes to any 
page at random, and E is an n x n matrix whose entries 
are all 1. The Markov chain whose matrix of transition 
probabilities is M converges to a unique steady state 
matrix, which gives an estimate of page ranks. 
Section 10.3 discusses a method that can be used to 
estimate the steady state matrix. 

d8nn/Shutterstock.com 


REMARK 


For a regular stochastic matrix 
P, the sequence of successive 
powers 


PPA PR ea 


approaches a stable matrix P. 
The entries in each column of 
P are equal to the corresponding 
entries in the steady state 
matrix X. You are asked to 
show this in Exercise 55. 
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STEADY STATE MATRIX OF A MARKOV CHAIN 


In Example 3, notice that there is little difference between the numbers of subscribers 
after 10 years and after 15 years. If you continue the process shown in this example, 
then the state matrix X,, eventually reaches a steady state. That is, as long as the matrix 
P does not change, the matrix product P’X approaches a limit X. In Example 3, the limit 
is the steady state matrix 


1 
3 0.3333 A 

X =|| = | 0.4762 |. B Steady state matrix 
4 0.1905 None 


Check to see that PX = X, as shown below. 


1 1 
0.70 0.15 0.15]} 3 3 

PX = | 0.20 0.80 0.15//2|=|2/=X 
0.10 0.05 0.704) | 4 


In Example 5, you will verify the above result by finding the steady state matrix X. 

The matrix of transition probabilities P used above is an example of a regular 
stochastic matrix. A stochastic matrix P is regular when some power of P has only 
positive entries. 


EXAMPLE 4 Regular Stochastic Matrices 


a. The stochastic matrix 


0.70 0.15 0.15 
P = | 0.20 0.80 0.15 
0.10 0.05 0.70 


is regular because P! has only positive entries. 


b. The stochastic matrix 


0.50 1.00 
n pe ol 


is regular because 


= Be i 
0.25 0.50 


has only positive entries. 


c. The stochastic matrix 


7, O0 1 
P=|5 1 0 
+ 0 0 


is not regular because every power of P has two zeros in its second column. 

(Verify this.) | 
When P is a regular stochastic matrix, the corresponding regular Markov chain 
PX; PPX gy PP Koe 


approaches a unique steady state matrix X. You are asked to prove this in Exercise 56. 
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REMARK 


Recall from Example 2 that the 
state matrix consists of entries 
that are portions of the whole. 
So it should make sense that 


X, + Xx, + xX, = 1: 


REMARK 


If P is not regular, then the 
corresponding Markov chain 
may or may not have a unique 
steady state matrix. 


EXAMPLE 5 Finding a Steady State Matrix 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


Find the steady state matrix X of the Markov chain whose matrix of transition 
probabilities is the regular matrix 


0.70 0.15 0.15 

P = | 0.20 0.80 0.15}. 

0.10 0.05 0.70 
SOLUTION 


Note that P is the matrix of transition probabilities that you found in Example 2 and 
whose steady state matrix X you verified at the top of page 87. To find X, begin by 
X 


letting X = | x, |. Then use the matrix equation PX = X to obtain 


X3 
0.70 0.15 0.15 || x, x, 
0.20 0.80 0.15 || x, | = |x, 
0.10 0.05 0.70 || x; x4 


or 


0.70x, + 0.15x, + 0.15x, = x, 
0.20x, + 0.80x, + 0.15x3 = x, 
0.10x, + 0.05x, + 0.70x3 = x3. 


Use these equations and the fact that x, + x, + x, = 1 to write the system of linear 
equations below. 


—0.30x, + 0.15x, + 0.15x, = 0 
0.20x, — 0.20x, + 0.15x, = 0 
0.10x, + 0.05x, — 0.30x, = 0 


x, Xs oF x= 1. 


Use any appropriate method to verify that the solution of this system is 
= — 10 =, ote 
X= 3, %. =a, and x3 = 77. 


So the steady state matrix is 


1 

3} [0.3333 
X = || = | 0.4762 |. 

a| [0.1905 

21 


Check that PX = X. 


A summary for finding the steady state matrix X of a Markov chain is below. 


Finding the Steady State Matrix of a Markov Chain 


1. Check to see that the matrix of transition probabilities P is a regular matrix. 


2. Solve the system of linear equations obtained from the matrix equation 
PX = X along with the equation x, + x, +° +x = 1. 


3. Check the solution found in Step 2 in the matrix equation PX = X. 
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ABSORBING MARKOV CHAINS 


The Markov chain discussed in Examples 3 and 5 is regular. Other types of Markov 
REMARK chains can be used to model real-life situations. One of these includes absorbing 


In Exercise 50, you will Markov chains. 


investigate another type of Consider a Markov chain with n different states {S}, S,,. . ., S,}. The ith state S, 
Markov chain, one with is an absorbing state when, in the matrix of transition probabilities P, p; = 1. That 
reflecting boundaries. is, the entry on the main diagonal of P is | and all other entries in the ith column of P 


are 0. An absorbing Markov chain has the two properties listed below. 


1. The Markov chain has at least one absorbing state. 


2. It is possible for a member of the population to move from any nonabsorbing state 
to an absorbing state in a finite number of transitions. 


FE EXAMPLE 6 Absorbing and Nonabsorbing Markov Chains 
baa “Bos 


a. For the matrix 


y 
QQ”. 


) 50% 1 \ Si h $ 
100% 50% 04 0 ols, 
Figure 2.2 P=; 0 1 0O5)S, 7? To 


06 0 05] S, 
the second state, represented by the second column, is absorbing. Moreover, the 
corresponding Markov chain is also absorbing because it is possible to move from 
50% S, to S, in two transitions, and it is possible to move from S} to S, in one transition. 
) Sa ee 


( Í { \ (See Figure 2.2.) 


50% 100% b. For the matrix 


‘0 
Å 
E &. & 


50% 05 0 O ols 

40% 50% ! 

a ° p-|95 1 0 OS, 

Figure 2.3 “lo 0 04 gini” 
0 0 06 05|S, 


the second state is absorbing. However, the corresponding Markov chain is not 
absorbing because there is no way to move from state S, or state S, to state S,. (See 
Figure 2.3.) 


) X 20% 20% al tood c. The matrix 


100% 
From 
10% Č J ye 30% PAA 
Al | Í i i p 
05 0 02 OJS 
02 1 03 OJS, 
P= "T 
o1 0 04 olsi >? 
( ) 0.2 0 01 1/58, 
40% 
Figure 2.4 has two absorbing states: S, and S4. Moreover, the corresponding Markov chain is 


also absorbing because it is possible to move from either of the nonabsorbing 
states, S, or S}, to either of the absorbing states in one step. (See Figure 2.4.) | 
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It is possible for some absorbing Markov chains to have a unique steady state 


matrix. Other absorbing Markov chains have an infinite number of steady state 
matrices. Example 7 demonstrates. 


re " Finding Steady State Matrices of Absorbing 
SASS Markov Chains 


Find the steady state matrix X of each absorbing Markov chain with matrix of transition 


probabilities P. 
aoo o Aa 
a P=| 0 1 05 b. P=] ` 
06 0 05 01 0 04 0 
f l 0.2 0 01 1 
SOLUTION 


a. Use the matrix equation PX = X, or 


04 0 o| x, Xi 
0 1 O0O5ļjx%}|=]|x 
06 0 0.5] Xs 


along with the equation x, + x, + x, = 1 to write the system of linear equations 


—0.6x, =0 
0.5x, = 0 
0.6x, = 0.5x, = 0 


Xj Xe x= 1, 


The solution of this system is x, = 0, x, = 1, and x, = 0, so the steady state matrix 
isX =[0 1 OJ". Note that X coincides with the second column of the matrix of 
transition probabilities P. 


b. Use the matrix equation PX = X, or 


05 0 02 Off x, xX, 


0.2 1 03 Off x, _|% 
0.1 0 04 O}} x, X3 
0.2 0 O1 1x Xa 


along with the equation x, + x, + x, + x, = 1 to write the system of linear equations 


REMARK —0.5x, + 0.2x, =0 
Note that the steady state 0.2%, + 0.3.x, =0 
matrix for an absorbing 0.12, — 0.6x; =0 
Markov chain has nonzero 0.2x, + 0.1%; =0 
values only in the absorbing te AS RSH Lb 
state(s). These states absorb 
the population. The solution of this systemis x, = 0,x, = 1 — t,x, = 0,and x, = t, where ris any real 
number such that 0 < t < 1. So, the steady state matrix is X = [0 1-—+r 0 tf. 
The Markov chain has an infinite number of steady state matrices. ai 


In general, a regular Markov chain or an absorbing Markov chain with one 
absorbing state has a unique steady state matrix regardless of the initial state matrix. 
Further, an absorbing Markov chain with two or more absorbing states has an infinite 
number of steady state matrices, which depend on the initial state matrix. In Exercise 
49, you are asked to show this dependence for the Markov chain whose matrix of 
transition probabilities is given in Example 7(b). 
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2 5 5 Exercises See CalcChat.com for worked-out solutions to odd-numbered exercises. 


Stochastic Matrices In Exercises 1-6, determine 
whether the matrix is stochastic. 


PtH ry 


| 
UN yh 
d aair 


0.3 0.16 0.25 0.3 05 02 
3.|0.3 0.6 0.25 4. |01 0.2 0.7 
0.3 0.16 0.5 0.8 0.1 O.1 
1 0 0 0 
5. 0 1 0 0 
0 0 1 0 
0 0 0 1 
1 2 1 £. 
2 9 4 D 
L L L 4 
6 3 4 D 
6. L 2 L A 
6 9 4 D 
L 2 L 1 
6 9 4 5 


7. Airplane Allocation An airline has 30 airplanes in 
Los Angeles, 12 airplanes in St. Louis, and 8 airplanes 
in Dallas. During an eight-hour period, 20% of the 
planes in Los Angeles fly to St. Louis and 10% fly to 
Dallas. Of the planes in St. Louis, 25% fly to Los Angeles 
and 50% fly to Dallas. Of the planes in Dallas, 12.5% 
fly to Los Angeles and 50% fly to St. Louis. How many 
planes are in each city after 8 hours? 


8. Chemistry In a chemistry experiment, a test tube 
contains 10,000 molecules of acompound. Initially, 20% 
of the molecules are in a gas state, 60% are in a liquid 
state, and 20% are in a solid state. After introducing 
a catalyst, 40% of the gas molecules change to liquid, 
30% of the liquid molecules change to solid, and 50% 
of the solid molecules change to liquid. How many 
molecules are in each state after introducing the catalyst? 


Finding State Matrices In Exercises 9 and 10, use 
the matrix of transition probabilities P and initial state 
matrix X, to find the state matrices X,, X,, and X}. 


0.6 0.1 01 0.1 
9. P=|0.2 07 01|, =| 04 
0.2 0.2 0.8 0.8 
1 
06 02 0 3 
10. P=|0.2 07 01l, X% =]} 
0.2 0.1 09 1 


11. 


12. 


13. 


14. 


15. 
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=) 


Purchase of a Product The market research 
department at a manufacturing plant determines that 
20% of the people who purchase the plant’s product 
during any month will not purchase it the next month. 
On the other hand, 30% of the people who do not 
purchase the product during any month will purchase 
it the next month. In a population of 1000 people, 
100 people purchased the product this month. How 
many will purchase the product (a) next month and (b) in 
2 months? 


Spread of a Virus A medical researcher is studying 
the spread of a virus in a population of 1000 laboratory 
mice. During any week, there is an 80% probability 
that an infected mouse will overcome the virus, and 
during the same week there is a 10% probability that a 
noninfected mouse will become infected. Three 
hundred mice are currently infected with the virus. How 
many will be infected (a) next week and (b) in 3 weeks? 


Television Watching A college dormitory houses 
200 students. Those who watch an hour or more of 
television on any day always watch for less than an hour 
the next day. One-fourth of those who watch television 
for less than an hour one day will watch an hour or more 
the next day. Half of the students watched television for 
an hour or more today. How many will watch television 
for an hour or more (a) tomorrow, (b) in 2 days, and (c) 
in 30 days? 

Sports Activities Students in a gym class have a 
choice of swimming or playing basketball each day. 
Thirty percent of the students who swim one day will 
swim the next day. Sixty percent of the students who 
play basketball one day will play basketball the next 
day. Today, 100 students swam and 150 students played 
basketball. How many students will swim (a) tomorrow, 
(b) in two days, and (c) in four days? 

Smokers and Nonsmokers In a population of 
10,000, there are 5000 nonsmokers, 2500 smokers of 
one pack or less per day, and 2500 smokers of more 
than one pack per day. During any month, there is a 
5% probability that a nonsmoker will begin smoking 
a pack or less per day, and a 2% probability that a 
nonsmoker will begin smoking more than a pack 
per day. For smokers who smoke a pack or less per 
day, there is a 10% probability of quitting and a 10% 
probability of increasing to more than a pack per day. 
For smokers who smoke more than a pack per day, there 
is a5% probability of quitting and a 10% probability of 
dropping to a pack or less per day. How many people 
will be in each group (a) in 1 month, (b) in 2 months, 
and (c) in 1 year? 
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16. Consumer Preference In a population of 100,000 
consumers, there are 20,000 users of Brand A, 30,000 
users of Brand B, and 50,000 who use neither brand. 
During any month, a Brand A user has a 20% probability 
of switching to Brand B and a 5% probability of not 
using either brand. A Brand B user has a 15% probability 
of switching to Brand A and a 10% probability of not 
using either brand. A nonuser has a 10% probability of 
purchasing Brand A and a 15% probability of purchasing 
Brand B. How many people will be in each group (a) in 
1 month, (b) in 2 months, and (c) in 18 months? 


Regular and Steady State Matrices In Exercises 
17-30, determine whether the stochastic matrix P is 


regular. Then find the steady state matrix X of the 
Markov chain with matrix of transition probabilities P. 


0.5 0.1 0 03 
Bed be | ci k a] 
1 0.75 02 0 
ee lo | oe E i 
1 1 2 He 
21. P = l ] 22. P = ; g 
2 3 5 10 
2 3 1 2 1 1 
5 10 2 9 4 3 
23. P=|4 = 24. P=|} 3 3 
2 l 2 4 1 l 
5 2 5 9 4 3 
1 0 0.15 
25.P=|0 1 0.10 
0 0 0.75 
1 1 
2 5 1 
26.P=|; § 0 
1 3 
6 5 0 
0.22 0.20 0.65 
27. P=|0.62 0.60 0.15 
0.16 0.20 0.20 
01 0 03 
28. P=|0.7 1 03 
0.2 0.4 
1 1 1 
4 3 5 | 
1 1 1 
i 4 & 0 
wps 5 o o 
4 3 0 0 
1 
1 0 0 0 
1 0 0 0 
0 0 1 0 
WPS + wy. d 
0 0 0 1 


31. (a) Find the steady state matrix X using the matrix of 
transition probabilities P in Exercise 9. 


(b) Find the steady state matrix X using the matrix of 
transition probabilities P in Exercise 10. 


32. Find the steady state matrix for each stochastic matrix 
in Exercises 1-6. 


33. Fundraising A nonprofit organization collects 
contributions from members of a community. During 
any year, 40% of those who make contributions will 
not contribute the next year. On the other hand, 10% of 
those who do not make contributions will contribute the 
next year. Find and interpret the steady state matrix for 
this situation. 


34. Grade Distribution In a college class, 70% of the 
students who receive an “A” on one assignment will 
receive an “A” on the next assignment. On the other 
hand, 10% of the students who do not receive an “A” 
on one assignment will receive an “A” on the next 
assignment. Find and interpret the steady state matrix 
for this situation. 


35. Stock Sales and Purchases Eight hundred fifty 
stockholders invest in one of three stocks. During any 
month, 25% of Stock A holders move their investment 
to Stock B and 10% to Stock C. Of Stock B holders, 
10% move their investment to Stock A. Of Stock C 
holders, 15% move their investment to Stock A and 5% 
to Stock B. Find and interpret the steady state matrix for 
this situation. 


36. Customer Preference Two movie theatres that 
show several different movies each night compete for 
the same audience. Of the people who attend Theatre A 
one night, 10% will attend again the next night and 5% 
will attend Theatre B the next night. Of the people who 
attend Theatre B one night, 8% will attend again the 
next night and 6% will attend Theatre A the next night. 
Of the people who attend neither theatre one night, 3% 
will attend Theatre A the next night and 4% will attend 
Theatre B the next night. Find and interpret the steady 
state matrix for this situation. 


Absorbing Markov Chains In Exercises 37-40, 
determine whether the Markov chain with matrix of 
transition probabilities P is absorbing. Explain. 


08 03 0 1 0 0 

37.P=|02 01 ol 38P=l|0 03 09 
006 1 0 07 0l 
2 1 
a: ogo O A 03 0.7 02 0 
53 5053 02 01 O1 0 
5 5 es 5 N 

9, P = 40. P = 

3 2 1 1 9 i 0.1 01 O1 0 
roai 04 01 06 1 
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Finding a Steady State Matrix In Exercises 41-44, 
find the steady state matrix X of the absorbing Markov 
chain with matrix of transition probabilities P. 


06 0 03 01 0 0 
41.P=|02 1 06| 42.P=|02 1 0 
02 0 O1 07 0 1 
1 02 01 03 
0 03 06 03 
= 0 01 02 0.2 
0 0.4 01 02 
07 0 02 «of 
01 1 05 06 
Mons 0 0 02 02 
0.2 0 O1 O1 


45. Epidemic Model In a population of 200,000 people, 
40,000 are infected with a virus. After a person becomes 
infected and then recovers, the person is immune 
(cannot become infected again). Of the people who 
are infected, 5% will die each year and the others will 
recover. Of the people who have never been infected, 
25% will become infected each year. How many people 
will be infected in 4 years? 


46. Chess Tournament Two people are engaged in a 
chess tournament. Each starts with two playing chips. 
After each game, the loser must give the winner one 
chip. Player 2 is more advanced than Player | and has a 
70% chance of winning each game. The tournament is 
over when one player obtains all four chips. What is the 
probability that Player 1 will win the tournament? 


47. Explain how you can determine the steady state matrix 
X of an absorbing Markov chain by inspection. 


48. CAPSTONE 


(a) Explain how to find the nth state matrix of a 
Markov chain. 


(b) Explain how to find the steady state matrix of a 


Markov chain. 
(c) What is a regular Markov chain? 
(d) What is an absorbing Markov chain? 


(e) How is an absorbing Markov chain different than a 
regular Markov chain? 


49. Consider the Markov chain whose matrix of transition 
probabilities P is given in Example 7(b). Show that the 
steady state matrix X depends on the initial state matrix 
X, by finding X for each Xp. 


0.25 0.25 
0.25 0.25 
(a) Xo = | 0.25 (6) Xo = | 9.40 
0.25 0.10 


2.5 Exercises 93 


50. Markov Chain with Reflecting Boundaries The 
figure below illustrates an example of a Markov chain 
with reflecting boundaries. 


00%, poe. pom 
40% 30% 100% 


(a) Explain why it is appropriate to say that this type of 
Markov chain has reflecting boundaries. 


(b) Use the figure to write the matrix of transition 
probabilities P for the Markov chain. 


(c) Find P% and P?!. Find several other high even 
powers 2n and odd powers 2n + 1 of P. What do 
you observe? 


(d) Find the steady state matrix X of the Markov chain. 
How are the entries in the columns of P?” and P2”*! 
related to the entries in X? 


Nonabsorbing Markov Chain In Exercises 51 and 52, 
consider the matrix P in Example 6(b). 


51. Is it possible to find a steady state matrix X for the 
corresponding Markov chain? If so, find a steady state 
matrix. If not, explain why. 


52. Create a new matrix P’ by changing the second column 
of P to [0.6 0.4 0 OF, resulting in a second 
state that is no longer absorbing. Determine whether 
each matrix X below can be a steady state matrix for the 
Markov chain corresponding to P’. Explain. 


6 
ir 0 

$ 
T (0) 
@x=|" (b) x=]; 
0 N 
11 
0 6 


= 


53. Proof Prove that the product of two 2 x 2 stochastic 
matrices is stochastic. 

54. Proof Let P be a2 x 2 stochastic matrix. Prove that 
there exists a 2 x 1 state matrix X with nonnegative 
entries such that PX = X. 


55. In Example 5, show that for the regular stochastic 
matrix P, the sequence of successive powers 


P, P, P,... 


approaches a stable matrix P, where the entries in each 
column of P are equal to the corresponding entries in the 
steady state matrix X. Repeat for several other regular 
stochastic matrices P and corresponding steady state 
matrices X. 


56. Proof Prove that when P is a regular stochastic 
matrix, the corresponding regular Markov chain 


PXo, PXo, PXo. 


approaches a unique steady state matrix X. 
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2.6 More Applications of Matrix Operations 


Use matrix multiplication to encode and decode messages. 


Use matrix algebra to analyze an economic system (Leontief 
input-output model). 


Find the least squares regression line for a set of data. 


CRYPTOGRAPHY 


A cryptogram is a message written according to a secret code (the Greek word kryptos 
means “hidden’”). One method of using matrix multiplication to encode and decode 
messages is introduced below. 

To begin, assign a number to each letter in the alphabet (with 0 assigned to a blank 
space), as shown. 


0= _— 9=1 18 =R 
1=A 10=J 19=§ 
2=B 1l=K 20 = T 
3=C 12=L 21=U 
4=D 13 =M 22=V 
5=E 14=N 23 = W 
6=F 15=0 24=xX 
7=G 16=P 25 =Y 
8=H 17 =Q 26 =Z 


Then convert the message to numbers and partition it into uncoded row matrices, each 
having n entries, as demonstrated in Example 1. 


EXAMPLE 1 Forming Uncoded Row Matrices 


Write the uncoded row matrices of size 1 x 3 for the message MEET ME MONDAY. 
SOLUTION 


Partitioning the message (including blank spaces, but ignoring punctuation) into groups 
of three produces the uncoded row matrices shown below. 


[13 5 5] [20 0 13] [5 0 13] [15 14 4] [1 25 0] 


MEET ME | MONDA Y 
Note the use of a blank space to fill out the last uncoded row matrix. m 
LINEAR Information security is of the utmost importance when 


conducting business online. If a malicious party should 
ALGEBRA receive confidential information such as passwords, 
APPLIED personal identification numbers, credit card numbers, 
Social Security numbers, bank account details, or sensitive 
company information, then the effects can be damaging. To 
protect the confidentiality and integrity of such information, 
Internet security can include the use of data encryption, the 
process of encoding information so that the only way to 
decode it, apart from an “exhaustion attack,” is to use a key. 
Data encryption technology uses algorithms based on the 
material presented here, but on a much more sophisticated 
level, to prevent malicious parties from discovering the key. 


Andrea Danti/Shutterstock.com 
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To encode a message, choose an n x n invertible matrix A and multiply the 
uncoded row matrices (on the right) by A to obtain coded row matrices. Example 2 
demonstrates this process. 


EXAMPLE 2 Encoding a Message 


Use the invertible matrix 


1 =2. 2 
A=|-1 1 3 
1-1 =4 
to encode the message MEET ME MONDAY. 
SOLUTION 


Obtain the coded row matrices by multiplying each of the uncoded row matrices found 
in Example | by the matrix A, as shown below. 


Uncoded Encoding Coded Row 

Row Matrix Matrix A Matrix 
1 =2). 2 

[113 5 5])/-1 1 3}=[13 -26 21] 
1 -1 =4 
1-2 2 

[20 0 13])/-1 1 3| = [33 -53 —12] 
1 =1 =4 
1 =2 2 

[5 0 13]-1 1 3| = [18 -23 —42] 
1 `i =4 
1 =2 2 

[15 14 4])/-1 1 3|=[5 -20 56] 
1 =1 =4 
1 =2 2 

[1 25 oļ]-—1 1 3}=[-24 23 77] 
1 -1 —4 


The sequence of coded row matrices is 


[13 —26 21][33 —53 —12][18 -23 —42][5 -20 56ļ[-24 23 77]. 


Finally, removing the matrix notation produces the cryptogram 


13 —26 21 33 —53 =12 18 —23 —42 5 —20 56 —24 23 77. m 


For those who do not know the encoding matrix A, decoding the cryptogram 
found in Example 2 is difficult. But for an authorized receiver who knows the 
encoding matrix A, decoding is relatively simple. The receiver just needs to multiply 
the coded row matrices by A7! to retrieve the uncoded row matrices. In other words, if 


X=[x, Hm... x] 


is an uncoded 1 x n matrix, then Y = XA is the corresponding encoded matrix. The 
receiver of the encoded matrix can decode Y by multiplying on the right by AT! to 
obtain 


YA"! = (XA)A7! = X. 


Example 3 demonstrates this procedure. 
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EXAMPLE 3 Decoding a Message 


Use the inverse of the matrix 


1-2 2 
A=|-1 1 3 
1-1 -4 


to decode the cryptogram 


13 —26 21 33 —53 —12 18 —23 —42 5 —20 56 —24 23 77. 


SOLUTION 
Begin by using Gauss-Jordan elimination to find A~!. 
[A 1 Do a~] 
l= 2 1 0o 0 1 0 0 -—1-—10:.=8 


= 1 3 0 1 0o} => jo 1 0 =i =6 =5 
1 -1 -4 0 0 0 0 1 0 =I -1 


jk 


Now, to decode the message, partition the message into groups of three to form the 
coded row matrices 


[13 -26 21][33 -53 —12][18 -23 —42][5 -20 56][—-24 23 77]. 


To obtain the decoded row matrices, multiply each coded row matrix by A`! 


(on the right). 
Coded Row Decoding Decoded 
Matrix Matrix A`! Row Matrix 
—1 -10 -8 
[13 -26 21] o 7 —5}=[13 5 5] 
-1 
—1 -10 -8 
[33 —53 —12] 7 a —-5|=[20 0 13] 
-1 
—1 -10 -8 
[18 -23 —42] o $ -5|=[5 0 13] 
-1 
=] =10 -8 
[5 -20 56] E i —5|=[15 14 4] 
=i 
=] -10 =8 
[-24 23 77ļ-1 -6 -5|=[1 25 o0] 
0: =1. =1 


The sequence of decoded row matrices is 
113 5 s520 0 BJ]5 0 13]15 14 4][1 25 0] 
and the message is 


3.5 5 20 0 135 0 13 15 14 4 1 . 
MEET __ ME_MONDAY ui 
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LEONTIEF INPUT-OUTPUT MODELS 


In 1936, American economist Wassily W. Leontief (1906-1999) published a model 
concerning the input and output of an economic system. In 1973, Leontief received a 
Nobel prize for his work in economics. A brief discussion of Leontief’s model follows. 

Consider an economic system that has n different industries 4, ,. . ., Z, each 
having input needs (raw materials, utilities, etc.) and an output (finished product). 
In producing each unit of output, an industry may use the outputs of other industries, 
including itself. For example, an electric utility uses outputs from other industries, such 
as coal and water, and also uses its own electricity. 

Let d;, be the amount of output the jth industry needs from the ith industry to produce 


one unit of output per year. The matrix of these coefficients is the input-output matrix. 


User (Output) 
dı dy... Ay} h 
p= dai daz oxy dn ty Supplier (Input) 
bids wick Ol kh 


To understand how to use this matrix, consider d,, = 0.4. This means that 
for Industry 2 to produce one unit of its product, it must use 0.4 unit of Industry 1’s 
product. If d,, = 0.2, then Industry 3 needs 0.2 unit of its own product to produce one 
unit. For this model to work, the values of d;; must satisfy 0 = d;; = 1 and the sum of 
the entries in any column must be less than or equal to 1. 


EXAMPLE 4 Forming an Input-Output Matrix 


Consider a simple economic system consisting of three industries: electricity, water, 
and coal. Production, or output, of one unit of electricity requires 0.5 unit of itself, 
0.25 unit of water, and 0.25 unit of coal. Production of one unit of water requires 
0.1 unit of electricity, 0.6 unit of itself, and 0 units of coal. Production of one unit of 
coal requires 0.2 unit of electricity, 0.15 unit of water, and 0.5 unit of itself. Find the 
input-output matrix for this system. 


SOLUTION 


The column entries show the amounts each industry requires from the others, and from 
itself, to produce one unit of output. 


User (Output) 


———SS 
E W C 


0.5 01 02 | E 
0.25 0.6 0.15| W ? Supplier (Input) 
0.25 0 05 | C 


The row entries show the amounts each industry supplies to the others, and to itself, 
for that industry to produce one unit of output. For instance, the electricity industry 
supplies 0.5 unit to itself, 0.1 unit to water, and 0.2 unit to coal. | 


To develop the Leontief input-output model further, let the total output of the 
ith industry be denoted by x;. If the economic system is closed (that is, the economic 
system sells its products only to industries within the system, as in the example above), 
then the total output of the ith industry is 


x = dx, + dox, t+ +--+ 4d,,x Closed system 


L L avn? 
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REMARK 


The economic systems 
described in Examples 4 and 5 
are, of course, simple ones. 

In the real world, an economic 
system would include many 
industries or industrial groups. 
A detailed analysis using 

the Leontief input-output 
model could easily require 

an input-output matrix greater 
than 100 x 100 in size. Clearly, 
this type of analysis would 
require the aid of a computer. 


On the other hand, if the industries within the system sell products to nonproducing 
groups (such as governments or charitable organizations) outside the system, then the 
system is open and the total output of the ith industry is 


x = dyx, + dyx, +--+ =+ d,,x 


L L invn 


+e; Open system 


where e, represents the external demand for the ith industry’s product. The system of 
n linear equations below represents the collection of total outputs for an open system. 


X= dyyxX, tdp +++ ++ dint + é 
X = dy X, + dX ++ + + + dX, + e 
Xn = dX T dX ag 9 ee dinXn + en 


The matrix form of this system is X = DX + E, where X is the output matrix and E 
is the external demand matrix. 


= Solving for the Output Matrix 
EXAMPLE 5 of an Open System 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


An economic system composed of three industries has the input-output matrix shown 
below. 
User (Output) 

SS 

A B C 

0.1 043 0 A 

D=/0.15 0 0.37 | B ẹ Supplier (Input) 
0.23 0.03 0.02| C 


Find the output matrix X when the external demands are 


20,000 A 

E = | 30,000 |. B 

25,000 C 
SOLUTION 


Letting J be the identity matrix, write the equation X = DX + E as IX — DX = E, 
which means that (J — D)X = E. Using the matrix D above produces 


0.9 — 0.43 0 
I— D = | -0.15 1 —0.37 |. 
—0.23 —0.03 0.98 


Using Gauss-Jordan elimination, 


1.25 0.55 0.21 
(I-D)! =]|0.30 1.14 0.43]. 
0.30 0.16 1.08 


So, the output matrix is 


1.25 0.55 0.21 || 20,000 46,750 A 
X= (I— D)'E ~|0.30 1.14 0.43 || 30,000 | = | 50,950 B 
0.30 0.16 1.08 || 25,000 37,800 E 


To produce the given external demands, the outputs of the three industries must be 
approximately 46,750 units for industry A, 50,950 units for industry B, and 37,800 units 
for industry C. | 
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6+ Model 1 (5, 6)@ 


Figure 2.7 
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LEAST SQUARES REGRESSION ANALYSIS 


You will now look at a procedure used in statistics to develop linear models. The next 
example demonstrates a visual method for approximating a line of best fit for a set of 
data points. 


EXAMPLE 6 A Visual Straight-Line Approximation 


Determine a line that appears to best fit the points (1, 1), (2, 2), (3, 4), (4, 4), and (5, 6). 
SOLUTION 


Plot the points, as shown in Figure 2.5. It appears that a good choice would be the line 
whose slope is | and whose y-intercept is 0.5. The equation of this line is 


y=0.5 +x. m 


An examination of the line in Figure 2.5 reveals that you can improve the fit 
by rotating the line counterclockwise slightly, as shown in Figure 2.6. It seems clear 
that this line, whose equation is y = 1.2x, fits the points better than the original line. 


Figure 2.5 Figure 2.6 
One way of measuring how well a function y = f(x) fits a set of points 


Gi yi) con Y2), <o’ C Yn) 


is to compute the differences between the values from the function f(x,) and the 
actual values y,. These values are shown in Figure 2.7. By squaring the differences and 
summing the results, you obtain a measure of error called the sum of squared error. 
The table shows the sums of squared errors for the two linear models. 


Model 1: f(x) = 0.5 + x Model 2: f(x) = 1.2x 


x z fæ) | Di- SP ; ; ) | Ly — SP 
1 1 15 | (-0.5) 2 | (-0.2)2 

2 2 25 | (-05) 4 | (-0.4)? 

3 4 3.5 | (+05)? 6 | (+0.4) 

4 4 45 | (-0.5) 8 | (—0.8) 

5 6 5.5 | (+0.5) 0 | (0.0) 


Sum 1.00 
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The sums of squared errors confirm that the second model fits the points better 
than the first model. 

Of all possible linear models for a given set of points, the model that has the best 
fit is the one that minimizes the sum of squared error. This model is the least squares 
regression line, and the procedure for finding it is the method of least squares. 


Definition of Least Squares Regression Line 
For a set of points 
(isdi) Oya) e ao Yn) 
the least squares regression line is the linear function 
f(x) = a + ax 
that minimizes the sum of squared error 


Ly, = flix) F as Ly. -= fP Per 


"+ [yn = SP 


To find the least squares regression line for a set of points, begin by forming the 
system of linear equations 


yı = fæ) + iy -fæl 
Yz = fx) +t Ly, = Fx) 


Yn = Fn) + Dyn faa 
where the right-hand term 
Ly; =f (x;)] 


of each equation is the error in the approximation of y; by f(x,). Then write this 
error as 


e; =y — fx) 
and write the system of equations in the form 
yı = (a + ax) + e; 


J» > (ao + aX) te, 


y, = (ao + axX,) + e,- 


Now, if you define Y, X, A, and E as 


yı 1 xy ei 

Y= X2 ya 1 %2 a=|%| pale 
ay 

Yn 1 Xn en 


then the n linear equations may be replaced by the matrix equation 
Y = XA +E. 


Note that the matrix X has a column of 1°’s (corresponding to a,) and a column 
containing the x; s. This matrix equation can be used to determine the coefficients of 
the least squares regression line, as shown on the next page. 
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REMARK 


You will learn more about this 
procedure in Section 5.4. 


Least Squares Regression Line 


Figure 2.8 
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Matrix Form for Linear Regression 


For the regression model Y = XA + E, the coefficients of the least squares 
regression line are given by the matrix equation 


A = (XTX)-1XTY 


and the sum of squared error is EE. 


Example 7 demonstrates the use of this procedure to find the least squares 
regression line for the set of points from Example 6. 


EXAMPLE 7 Finding the Least Squares Regression Line 


Find the least squares regression line for the points (1, 1), (2, 2), (3, 4), (4, 4), 
and (5, 6). 


SOLUTION 


The matrices X and Y are 


1 1 1 
1 2 2 
X=)1 3 and Y=]ļ|4]. 
1 4 4 
1 5 6 
This means that 
1 1 
1 2 
1 1 1 1 1 5 15 
Ty = _ 
AA f 2 3 4 Ji À F A 
1 4 
1 5 
and 
1 
2 
1 1 1 1 1 17 
Ty = = 
TEESE HEN 


lon 


Now, using (X'X)~! to find the coefficient matrix A, you have 


A = (X™X)-1XxTy 


_ o J9 s] 
1-15 5 IL 63 
: E 
1.2) 
So, the least squares regression line is 


y= —0.2 + 12x 


as shown in Figure 2.8. The sum of squared error for this line is 0.8 (verify this), which 
means that this line fits the data better than either of the two experimental linear 
models determined earlier. 
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2 = 6 Exercises See CalcChat.com for worked-out solutions to odd-numbered exercises. 


ee [kj 


Encoding a Message In Exercises 1 and 2, write the acd 9. Decoding a Message Use a software program or a 


uncoded row matrices for the message. Then encode the 
message using the matrix A. 


1. Message: SELL CONSOLIDATED 
Row Matrix Size: 1x3 
1 -l 0 
Encoding Matrix: A= 1 0 =l 
—6 2 3 
2. Message: HELP IS COMING 
Row Matrix Size: 1x4 


Encoding Matrix: A= 
3 1 =2 =4 


Decoding a Message In Exercises 3-6, use AT! to 
decode the cryptogram. 


1 2 
a 
: | I 
11 21 64 112 25 50 29 53 23 46 40 75 55 92 
2 3 
Ias f al 


85 120 6 8 10 15 84 117 42 56 90 125 60 80 
30 45 19 26 


i 2 2 
5A=| 3 7 9], 
-1 -4 -7 


13 19. 10 =f =33 =77 3 =2 =14 4 1 =—9.=5 
—25 -47 4 1 -9 


3 —4 2 
6. A =|0 2 1], 
4 -5 3 


112 =140 83 19 =25 13 72 =76 61 95 =118 
71 20 21 38 35 —23 36 42 —48 32 


7. Decoding a Message The cryptogram below was 
encoded with a 2 x 2 matrix. The last word of the 
message is __ RON. What is the message? 

8 2) =] =10 =] = 5 105 25 5 19=1 6 
20 40 —18 —18 1 16 

8. Decoding a Message The cryptogram below was 
encoded with a 2 x 2 matrix. The last word of the 
message is __SUE. What is the message? 

5.2 25 11 =2 =7 =15 =15 32 14 =3 =13-38 
19 —19 —19 37 16 


10. 


11. 


12. 


graphing utility to decode the cryptogram. 


1 0 2 
A=|2 -1 1 
0 1 2 


38 —14 29 56 —15 62 17 3 38 18 20 76 18 -5 
21 29 =7 32 32 9 77 36 —8 48 33 —5 51 41 
3 79 12 1 26 58 —22 49 63 —19 69 28 8 67 31 
—11 27 41 —18 28 


Decoding a Message A code breaker intercepted 
the encoded message below. 


45 —35 38 —30 18 —18 35 —30 81 —60 42 
—28 75 —55 2 —2 22 —21 15 —10 


Let the inverse of the encoding matrix be 


E 
y z 
(a) You know that [45 —35] A~! = [10 15] and 


[38 —30]A7! =[8 14]. Write and solve two 
systems of equations to find w, x, y, and z. 
(b) Decode the message. 
Industrial System A system composed of two 
industries, coal and steel, has the input requirements 
below. 
(a) To produce $1.00 worth of output, the coal industry 
requires $0.10 of its one product and $0.80 of steel. 
(b) To produce $1.00 worth of output, the steel industry 
requires $0.10 of its own product and $0.20 of coal. 
Find D, the input-output matrix for this system. 
Then solve for the output matrix X in the equation 
X = DX + E, where E is the external demand matrix 


10,000 

E= 7 ; 

Ead 

Industrial System An industrial system has two 

industries with the input requirements below. 

(a) To produce $1.00 worth of output, Industry A 
requires $0.30 of its own product and $0.40 of 
Industry B’s product. 

(b) To produce $1.00 worth of output, Industry B 
requires $0.20 of its own product and $0.40 of 
Industry A’s product. 

Find D, the input-output matrix for this system. 


Then solve for the output matrix X in the equation 
X = DX + E, where E is the external demand matrix 


10,000 
Bz se 
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Solving for the Output Matrix A small community 
includes a farmer, a baker, and a grocer and has the 
input-output matrix D and external demand matrix E 
below. 


Farmer Baker Grocer 


0.4 0.5 0.5 | Farmer 1000 
D= ]ļ|0.3 0.0 0.3 | Baker and E = |1000 
0.2 0.2 0.0 | Grocer 1000 


Solve for the output matrix X in the equation 
X = DX +E. 


Solving for the Output Matrix An industrial system 
with three industries has the input-output matrix D and 
external demand matrix E below. 


0.2 04 0.4 5000 
D=|04 0.2 0.2} and £E =} 2000 
0.0 0.2 0.2 8000 


Solve for the output matrix X in the equation 
X = DX +E. 


Least Squares Regression Analysis In Exercises 
15-18, (a) sketch the line that appears to be the best fit 
for the given points, (b) find the least squares regression 
line, and (c) determine the sum of squared error. 


15. 


17. 


g 16. A 
4+ 4T 
3 3), al (3,2) 
-1,1 
2+ Cl l + @(1, 1) 
4 }——} > x 
(2,0) 190,1) 3,0-1 | 1 2 3 
¢— }—f > x 
25-4 1 2 =a 
7 18. > 
A 
44094) 4+ 5, 2) 
e 3+ (4,2) \ (6, 2) 
eT %,3) 24 GDN oé 
2+ 1 a e e— (4,1) 
dia $ee 
aD (2,0) at § 
| Je 21 2,0) 3,0) 
-1 1 2 3 ~ 


Finding the Least Squares Regression Line In 
Exercises 19-26, find the least squares regression line. 


19. 
20. 
21. 
22. 
23. 
24. 
25. 
26. 


(0, 0), (1, 1), (2, 4) 
(1, 0), (3, 3), (5, 6) 
(—2, 0), (—1, 1), (0, 1), (1, 2) 

(—4, — 1), (—2, 0), (2, 4), (4, 5) 

(=5, 1), (1, 3), (2, 3), (2, 5) 

(—3, 4), (—1, 2), (1, 1), (3, 0) 

(=5, 10), (— 1, 8), (3, 6), (7, 4), (5, 5) 
(0, 6), (4, 3), (5, 0), (8, —4), (10, —5) 


27 


28. 


29. 


31 


2.6 Exercises 103 


. Demand A hardware retailer wants to know the 
demand for a rechargeable power drill as a function 
of price. The ordered pairs (25, 82), (30, 75), (35, 67), 
and (40, 55) represent the price x (in dollars) and the 
corresponding monthly sales y. 


(a) Find the least squares regression line for the data. 
(b) Estimate the demand when the price is $32.95. 


Wind Energy Consumption The table shows the 
wind energy consumptions y (in quadrillions of Btus, 
or British thermal units) in the United States from 
2009 through 2013. Find the least squares regression 
line for the data. Let ¢ represent the year, with t = 9 
corresponding to 2009. Use the linear regression 
capabilities of a graphing utility to check your work. 
(Source: U.S. Energy Information Administration) 


2009 2010 2011 
1.17 


2012 2013 
1.34 1.60 


Year 


Consumption, y | 0.72 0.92 


Wildlife A wildlife management team studied the 
reproduction rates of deer in three tracts of a wildlife 
preserve. The team recorded the number of females x in 
each tract and the percent of females y in each tract that 
had offspring the following year. The table shows the 
results. 


100 120 140 
75 68 55 


Number, x 


Percent, y 


(a) Find the least squares regression line for the data. 
(b) Use a graphing utility to graph the model and the 
data in the same viewing window. 

(c) Use the model to create a table of estimated values for 
y. Compare the estimated values with the actual data. 
(d) Use the model to estimate the percent of females 
that had offspring when there were 170 females. 


(e) Use the model to estimate the number of females 
when 40% of the females had offspring. 


30. CAPSTONE 


(a) Explain how to use matrix multiplication to encode 
and decode messages. 


(b) Explain how to use a Leontief input-output model 
to analyze an economic system. 


(c) Explain how to use matrices to find the least 
squares regression line for a set of data. 


. Use your school’s library, the Internet, or some other 
reference source to derive the matrix form for linear 
regression given at the top of page 101. 
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2 Review Exercises 


Operations with Matrices In Exercises 1-6, perform 
the matrix operations. 


2 1 0 5 3 -6 
L F 5 MEEF -2 °] 
i 2 | 
2 -2/5 <A) elt 2 
6 0 1 4 
1 2 
a aE a §] 
6 0 
af Alli =3 i 
2 Alla 0o o0 
t 3 Bie — 32 
slo 2 =4llo 3 =i 
o o 3|l0 o 2 


6 f all 4 +l J 
“16 OJL-3 1 0 4 
Solving a System of Linear Equations In Exercises 
7-10, write the system of linear equations in the form 
Ax = b. Then use Gaussian elimination to solve this 
matrix equation for x. 


7. 2X4 + X= =8 8. 2x,-— x= S 


x, + 4x, = -4 3x, + 2x, = —4 
9. = 34, — yt xy = 0 
2x, + 4x, — 5x, = —3 
X, — 2% +3x,= 1 
10. 2x, + 3x, + x, = 10 
2X, — 3%, — 3x, = 22 
4x, — 2x, + 3x, = —2 
Finding and Multiplying with a Transpose 


In Exercises 11-14, find A’, ATA, and AA’. 
11. =j A 7 12. A= f “4 


0 1 2 2 0 
1 

13.A=| 3 14. A=[1 -2 -3] 
-1 


Finding the Inverse of a Matrix In Exercises 15-18, 
find the inverse of the matrix (if it exists). 


3 1 4 -I1 
sè = w| 2] 
2 3 1 1 
17.;2 -3 =3 18. | 0 
4 0 3 0 


See CalcChat.com for worked-out solutions to odd-numbered exercises. 


I: 
|) 
Using the Inverse of a Matrix In Exercises 19-26, 
use an inverse matrix to solve each system of linear 
equations or matrix equation. 

19. 5x, +4x%,= 2 20. 3x, + 2x, = 1 
=y + x= —22 x, + 4x, = -3 
21. —x, + x, +2x,= 1 
2x, + 3x, + xy = =2 
5x, + 4x, + 2x = 4 
22. xX, +x, +2x,= 0 
Xx HX + X= =l 
2X, +x, + x= 2 


ol Bld 


0 L 2 =] 
25. | —1 3 1||x,| = 
2 =2 4 || x, 2 
0 1 2||x 0 
26. | 3 2 l}}y}=]-1 
4 -3 —-4]}|z =7 
Solving a Matrix Equation In Exercises 27 and 28, 
find A. 
4 -1 2 4 
-1 — -1 — 
ncayr=[4 T] rene 4] 


Nonsingular Matrix In Exercises 29 and 30, find x 
such that the matrix A is nonsingular. 


3 1 2 x 
maf OO wa 3] 


Finding the Inverse of an Elementary Matrix 
In Exercises 31 and 32, find the inverse of the elementary 
matrix. 


1 0 4 1 0 0 
31. | 0 1 0 32. | 0 6 0 
0 0 1 0 0 1 


Finding a Sequence of Elementary Matrices 
In Exercises 33-36, find a sequence of elementary 
matrices whose product is the given nonsingular matrix. 


2 3 =3 13 
33.[5 | [> l 

1 0 1 3 0 6 
35. | 0 I =2 36. | 0 2 0 

0 0 4 1 0 3 
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37. Find two 2 x 2 matrices A such that A? = J. 
38. Find two 2 x 2 matrices A such that A? = O. 


39. Find three 2 x 2 idempotent matrices. (Recall that a 
square matrix A is idempotent when A? = A.) 

40. Find 2 x 2 matrices A and B such that AB = O but 
BA # O. 


41. Consider the matrices below. 


1 -1 3 3 
2 0 4 2 
smior AE a |e | 
1 2 2 -1 


(a) Findscalarsa, b,andcsuchthat W = aX + bY + cZ. 


(b) Show that there do not exist scalars a and b such 
that Z = aX + bY. 


(c) Show that if aX + bY + cZ = O,thena = b= c =Q. 
42. Proof Let A, B, and A + B be nonsingular matrices. 
Prove that A™! + B~! is nonsingular by showing that 


(A! + B!)-! = A(A + B) 'B. 


Finding an LU-Factorization of a Matrix In Exercises 
43-46, find an LU-factorization of the matrix. 


2 5 =3 1 
asd | rl 
4 1 0 1 1 1 
45. 0 37 46. | 1 
=16 11 1 1 2 3 


Solving a Linear System Using LU-Factorization 
In Exercises 47 and 48, use an LU-factorization of the 
coefficient matrix to solve the linear system. 
47. x + z=3 
2x+ yt2z=7 
3x + 2y + 6z = 8 
48. 2x, + x, + x, - X= 
3X, + xX, n= -3 
— 2x; = 2 
8 


2X, + wt A= 2K 


49. Manufacturing A company manufactures tables and 
chairs at two locations. Matrix C gives the costs of 
manufacturing at each location. 


Location 1 Location 2 
C= | 627 681 l Tables 
135 150 | Chairs 


(a) Labor accounts for Z of the cost. Determine the 
matrix L that gives the labor costs at each location. 

(b) Find the matrix M that gives material costs at 
each location. (Assume there are only labor and 
material costs.) 


Review Exercises 105 


50. Manufacturing A corporation has four factories, 
each of which manufactures sport utility vehicles and 
pickup trucks. In the matrix 
A= ie 90 70 A 

40 20 60 60 
a; represents the number of vehicles of type i produced 
at factory jin one day. Find the production levels when 
production increases by 10%. 

51. Gasoline Sales Matrix A shows the numbers of 
gallons of 87-octane, 89-octane, and 93-octane gasoline 
sold at a convenience store over a weekend. 


Octane 


87 89 -93 


580 840 320| Friday 
A = |560 420 160] Saturday 
860 1020 540| Sunday 


Matrix B gives the selling prices (in dollars per gallon) 


and the profits (in dollars per gallon) for the three 
grades of gasoline. 


Selling Price Profit 
bii 0.05 | 87 

B = | bz 0.08 | 89 | Octane 
bai 0.10 | 93 


(a) Find AB and interpret the result. 


(b) Find the convenience store’s profit from gasoline 
sales for the weekend. 

52. Final Grades Two midterms and a final exam 
determine the final grade in a course at a liberal arts 
college. The matrices below show the grades for six 
students and two possible grading systems. 


Midterm Midterm Final 


1 2 Exam 
78 82 80 | Student 1 
84 88 85 | Student 2 
A= 92 93 90 | Student 3 
88 86 90 | Student 4 
74 78 80 | Student 5 
96 95 98 | Student 6 
Grading Grading 
System 1 System 2 
0.25 0.20 | Midterm 1 
B = | 0.25 0.20 | Midterm 2 
0.50 0.60 | Final Exam 


(a) Describe the grading systems in matrix B. 

(b) Compute the numerical grades for the six students 
(to the nearest whole number) using the two grading 
systems. 

(c) How many students received an “A” in each 
grading system? (Assume 90 or greater is an “A.”) 
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Polynomial Function In Exercises 53 and 54, find f(A) 
using the definition below. 

If f(x) = ay + ax + a,x? +++ + + a,x" is a polynomial 
function, then for a square matrix A, 

f(A) = ag + aA + a,A? +++ a, A”. 


53, f(x) = 6-7 +2, A= È ;| 


54. f(x) =2 — 3x + x, TE | 


Stochastic Matrices In Exercises 55-58, determine 
whether the matrix is stochastic. 


5 2 0.3 07 

25 25 k $ 
s s [02 07 

3 23 

F J 0 1l 

1 0 0 03 04 01 
57.10 0.5 01 58.102 04 05 

0 01 05 05 02 04 


Finding State Matrices In Exercises 59-62, use the 
matrix of transition probabilities P and initial state 
matrix X, to find the state matrices X,, X,, and X}. 


1 1 2 
2 4 3 
arf If 
2 4 3 
0.23 0.45 0.65 
a po me Xo = Bal 
0.50 0.25 0 0.5 
61. P=|025 0.70 0.15|, X,=|05 
0.25 0.05 0.85 0 
1 1 2 2 
3 3 3 9 
62.P=|; © 3) X= 
Doa (0 3 


63. Caribbean Cruise Three hundred people go on a 
Caribbean cruise. When the ship stops at a port, each 
person has a choice of going on shore or not. Seventy 
percent of the people who go on shore one day will not 
go on shore the next day. Sixty percent of the people 
who do not go on shore one day will go on shore the 
next day. Today, 200 people go on shore. How many 
people will go on shore (a) tomorrow and (b) the day 
after tomorrow? 


64. Population Migration A country has three regions. 
Each year, 10% of the residents of Region 1 move 
to Region 2 and 5% move to Region 3, 15% of the 
residents of Region 2 move to Region 1 and 5% move 
to Region 3, and 10% of the residents of Region 3 move 
to Region 1 and 10% move to Region 2. This year, each 
region has a population of 100,000. Find the populations 
of each region (a) in 1 year and (b) in 3 years. 


Regular and Steady State Matrix In Exercises 65—68, 
determine whether the stochastic matrix P is regular. 
Then find the steady state matrix X of the Markov chain 
with matrix of transition probabilities P. 


4 
[08 0.5 J 7 
Bra 05] os. =|) ] 
1 1 
3 6 0 0 02 
67.P=|4 0 0 68. P=|0.5 09 0 
Los o] 0.5 0.1 0.8 


69. Sales Promotion As a promotional feature, a store 
conducts a weekly raffle. During any week, 40% of the 
customers who turn in one or more tickets do not bother 
to turn in tickets the following week. On the other hand, 
30% of the customers who do not turn in tickets will 
turn in one or more tickets the following week. Find and 
interpret the steady matrix for this situation. 


70. Classified Documents A courtroom has 2000 
documents, of which 1250 are classified. Each week, 
10% of the classified documents become declassified 
and 20% are shredded. Also, 20% of the unclassified 
documents become classified and 5% are shredded. 
Find and interpret the steady state matrix for this 
situation. 


Absorbing Markov Chains In Exercises 71 and 72, 
determine whether the Markov chain with matrix of 
transition probabilities P is absorbing. Explain. 


0 04 01 1 0 0.38 
71. P=|0.7 03 04| 72. P=}]0 0.30 0 
0.3 03 0.5 0 0.70 0.62 


True or False? In Exercises 73-76, determine whether 
each statement is true or false. If a statement is true, give 
a reason or cite an appropriate statement from the text. 
If a statement is false, provide an example that shows the 
statement is not true in all cases or cite an appropriate 
statement from the text. 


73. (a) Addition of matrices is not commutative. 


(b) The transpose of the sum of matrices is equal to the 
sum of the transposes of the matrices. 


74. (a) If ann x n matrix A is not symmetric, then ATA is 
not symmetric. 


(b) If A and B are nonsingular n x n matrices, then 
A + Bisa nonsingular matrix. 


75. (a) A stochastic matrix can have negative entries. 


(b) A Markov chain that is not regular can have a 
unique steady state matrix. 


76. (a) A regular stochastic matrix can have entries of 0. 


(b) The steady state matrix of an absorbing Markov 
chain always depends on the initial state matrix. 
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Encoding a Message In Exercises 77 and 78, write the © 84. Solving for the Output Matrix An industrial system 
uncoded row matrices for the message. Then encode the 
message using the matrix A. 


77. 


78. 


Message: ONE IF BY LAND 
Row Matrix Size: 1x2 
Encoding Matrix: A= F | 
Message: BEAM ME UP SCOTTY 
Row Matrix Size: 1x3 
2 1 4 

Encoding Matrix: A= 3 1 3 

S2 =b s3 


Decoding a Message In Exercises 79-82, use A7! to 
decode the cryptogram. 


79. 


80. 


81. 


82. 


83. 


3-2 
a| d 


—45 34 36 —24 —43 37 
=39 31 


1 4 
a= | 


11:52 8) = 9-= 13° =39 5 20 12:56 -5 20 -=2 7 
9 41 25 100 


23 22 —37 29 57 —38 


| =2 2 
A=|-1 1 3 
p =] 

=p S 39°93 72 =6 
49 —16 19 —24 —46 -8 


9 93 4 —12 27 31 
7 99 


2 0 1 
A=|2 -1 0 
1 2 —4 
66 27 —31 37 5 —9 61 46 —73 46 —14 9 94 


21 —49 32 —4 12 66 31 —53 47 33 —67 32 19 
—56 43 =9 —20 68 23 —34 


Industrial System An industrial system has two 
industries with the input requirements below. 


(a) To produce $1.00 worth of output, Industry A 
requires $0.20 of its own product and $0.30 of 
Industry B’s product. 


(b) To produce $1.00 worth of output, Industry B 
requires $0.10 of its own product and $0.50 of 
Industry A’s product. 

Find D, the input-output matrix for this system. 

Then solve for the output matrix X in the equation 

X = DX + E, where E is the external demand matrix 


40,000 
po 


with three industries has the input-output matrix D and 
external demand matrix E below. 


0.1 03 0.2 3000 
D= {0.00 0.2 0.3} and E =| 3500 

04 0.1 O.1 8500 
Solve for the output matrix X in the equation 
X = DX +E. 


Finding the Least Squares Regression Line In 
Exercises 85-88, find the least squares regression line. 


AB 90. 


. (1, 5), (2, 4), (3, 2) 

. (2, 1), (3, 3), (4, 2), (5, 4), (6, 4) 
«1, 1), 3); 2, 1,4); 2,5) 
88. 


AB 89. 


(—2, 4), (-1, 2), (0, 1), (, —2), (2,-3) 


Cellular Phone Subscribers The table shows the 
numbers of cellular phone subscribers y (in millions) 
in the United States from 2008 through 2013. (Source: 
CTIA-The Wireless Association) 


2008 2009 2010 2011 2012 2013 
270 286 296 316 326 336 


Year 


Number, y 


(a) Find the least squares regression line for the data. 
Let x represent the year, with x = 8 corresponding 
to 2008. 


(b) Use the linear regression capabilities of a graphing 
utility to find a linear model for the data. How does 
this model compare with the model obtained in 
part (a)? 

(c) Use the linear model to create a table of estimated 
values for y. Compare the estimated values with the 
actual data. 

Major League Baseball Salaries The table shows 

the average salaries y (in millions of dollars) of Major 

League Baseball players on opening day of baseball 

season from 2008 through 2013. (Source: Major League 

Baseball) 


2008 2009 2010 2011 2012 2013 
3.00 3.01 3.10 3.21 3.39 


Year 


Salary, y | 2.93 


(a) Find the least squares regression line for the data. 
Let x represent the year, with x = 8 corresponding 
to 2008. 


(b) Use the linear regression capabilities of a graphing 
utility to find a linear model for the data. How does 
this model compare with the model obtained in 
part (a)? 

(c) Use the linear model to create a table of estimated 
values for y. Compare the estimated values with the 
actual data. 


Copyright 2017 Cengage Learning. All Rights Reserved. May not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eBook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage Learning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


108 Chapter 2 Matrices 


BÆ 1 Exploring Matrix Multiplication 


The table shows the first two test scores for Anna, Bruce, Chris, and David. Use the 


Navi Uata table to create a matrix M to represent the data. Input M into a software program or 


Anna 84 96 a graphing utility and use it to answer the questions below. 
Bme 56 72 1. Which test was more difficult? Which was easier? Explain. 
2. How would you rank the performances of the four students? 
Chris 78 83 1 0 
David 82 91 3. Describe the meanings of the matrix products M | J and M | ‘I 
4. Describe the meanings of the matrix products[1 0 0 OJMand[0 0 1 O|mM. 


1 1 
5. Describe the meanings of the matrix products M | i and | ‘I 


6. Describe the meanings of the matrix products [1 1 1 1]M andj[1 1 1 1]M. 
1 
7. Describe the meaning of the matrix product [1 1 1 m| | 


8. Use matrix multiplication to find the combined overall average score on 
both tests. 


9. How could you use matrix multiplication to scale the scores on test 1 by a 
factor of 1.1? 


2 Nilpotent Matrices 


Let A be a nonzero square matrix. Is it possible that a positive integer k exists such 
that A‘ = O? For example, find A? for the matrix 


0 1 2 
A=10 0 1 
0 0 0 


A square matrix A is nilpotent of index k when A + O, A? + O,. . .,A%! + O, 
but A* = O. In this project you will explore nilpotent matrices. 


1. The matrix in the example above is nilpotent. What is its index? 


f> 2. Use a software program or a graphing utility to determine which matrices below 
are nilpotent and find their indices. 


0 1 O 6 0 

(a) |; | (b) [i | (©) f J 
A 6 6 4 0o o0 0 
(d) l ol olo o ohw Oo 
Con a 6 


. Find 3 x 3 nilpotent matrices of indices 2 and 3. 

. Find 4 x 4 nilpotent matrices of indices 2, 3, and 4. 

. Find a nilpotent matrix of index 5. 

. Are nilpotent matrices invertible? Prove your answer. 

. When A is nilpotent, what can you say about A’? Prove your answer. 
. Show that if A is nilpotent, then J — A is invertible. 


o yuy ANNAU 


Supri Suharjoto/Shutterstock.com 
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3 Determinants 


3.1 The Determinant of a Matrix 
3.2 Determinants and Elementary Operations 
3.3 Properties of Determinants 

3.4 Applications of Determinants 


Software Publishing (p. 143) 


he 
ag? f 
og a E 


Engineering and Control (p. 130) 


Sudoku (p. 120) 


Volume of a Tetrahedron (p. 114) 


Clockwise from top left, Jet Propulsion Laboratory/NASA; Minerva Studio/Shutterstock.com; 1 09 
viviamo/Shutterstock.com; magnetix/Shutterstock.com; rgerhardt/Shutterstock.com 
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Chapter 3 Determinants 


3.1 The Determinant of a Matrix 


REMARK 


In this text, det(A) and |A| 
are used interchangeably to 


Although vertical bars are also 
used to denote the absolute 
value of a real number, the 
context will show which use 
is intended. Furthermore, it is 
common practice to delete the 
matrix brackets and write 


44, 2 
42, 42 
instead of 


ce fal 
49, 42 


REMARK 


Notice that the determinant of 
a matrix can be positive, zero, 
or negative. 


represent the determinant of A. 


Find the determinant of a 2 x 2 matrix. 
Find the minors and cofactors of a matrix. 
Use expansion by cofactors to find the determinant of a matrix. 


Find the determinant of a triangular matrix. 


THE DETERMINANT OF A 2 x 2 MATRIX 


Every square matrix can be associated with a real number called its determinant. 
Historically, the use of determinants arose from the recognition of special patterns that 
occur in the solutions of systems of linear equations. For example, the system 

ax; + a% = b; 

aX; + a3% = b, 
has the solution 


bian — bza; baa; — biaz; 


and x, = 


= _ = 
G19 T 21đ12 A149 7T 421đ12 


when 441432 — 21412 # 0. (See Exercise 53.) Note that both fractions have the same 
denominator, 441422 — 5,45. This quantity is the determinant of the coefficient matrix 
of the system. 


Definition of the Determinant of a 2 x 2 Matrix 


The determinant of the matrix 


Aaf aa 
44, a22 


is det(A) = |A| = a143 — ay44p. 


The diagram below shows a convenient method for remembering the formula for 
the determinant of a 2 x 2 matrix. 


[Al = [<2 
21 


= 41122 T Az)419 


The determinant is the difference of the products of the two diagonals of the matrix. 
Note that the order of the products is important. 


EXAMPLE 1 Determinants of Matrices of Order 2 


2 -3 2 -3 
a Fora =| 7 shaf 3] =2@) - 1-3) =443=7, 
2 1 2 1 
b. Forz = |} 3} al = | | = 2@) - 4) =4-4=0 
c. Forc=|° ? gS EE EA 
2 4p 2 4 2 ; wi 
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MINORS AND COFACTORS 


To define the determinant of a square matrix of order higher than 2, it is convenient to 
use minors and cofactors. 


Minors and Cofactors of a Square Matrix 


If A is a square matrix, then the minor M, of the entry a; is the determinant of 


the matrix obtained by deleting the ith row and jth column of A. The cofactor C ij 
of the entry a, is C) = (— 1)'*/M,,. 


For example, if A is a 3 x 3 matrix, then the minors and cofactors of a,, and a,, 
are as shown below. 


Minor of a5, Minor of a, 


Delete row 2 and column 1. Delete row 2 and column 2. 
Cofactor of a), Cofactor of ay, 
Cy, = (— 1° *'M,, = —My, Cy = (— 1) *7Mgy = M» 


The minors and cofactors of a matrix can differ only in sign. To obtain the cofactors of 
a matrix, first find the minors and then apply the checkerboard pattern of +’s and —’s 
shown at the left. Note that odd positions (where i + j is odd) have negative signs, and 


Sign Pattern for Cofactors me ee Stet ni 
even positions (where i + j is even) have positive signs. 


+ =- + 
A J 7 EN II8 Minors and Cofactors of a Matrix 
3 x 3 matrix Find all the minors and cofactors of 
+ - + = 0 2 1 
- + - + A=|3 -1 21. 
+ - + =- 4 0 1 
- + - + 


SOLUTION 


To find the minor M,,, delete the first row and first column of A and evaluate the 
determinant of the resulting matrix. 


4 x 4 matrix 


+ = + — + 
- + - + = 0> 
+ =- + = + -1 2], mla ‘| 1(1) — 0(2) = -1 
- + = + = 0 1 
+ = + — + 
f Verify that the minors are 
n x n matrix My ==! Mp = —5 M= 4 


M,,= 2 M,, = —4 M, = —8 

Ma = 5 M,, = —3 M}; = —6. 
Now, to find the cofactors, combine these minors with the checkerboard pattern of 
signs for a 3 x 3 matrix shown above. 

Ci = =1 Cz = 5 Cz = 4 
= -2 Cn =—4 Cy3 = 
Cy = 5 Cy = 3 C33 = —6 | 


S 
l 
l 
lore 
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REMARK 


The determinant of a matrix 
of order 1 is simply the entry 
of the matrix. For example, if 
A = [-2], then 


det(A) = —2. 


THE DETERMINANT OF A SQUARE MATRIX 


The definition below is inductive because it uses the determinant of a square matrix of 
order n — 1 to define the determinant of a square matrix of order n. 


Definition of the Determinant of a Square Matrix 


If A is a square matrix of order n = 2, then the determinant of A is the sum of 
the entries in the first row of A multiplied by their respective cofactors. That is, 


det(A) = |A| = Sa, C) = ay Cy, + ayy +- - - + 4,,C,,. 
jal 


Confirm that, for 2 x 2 matrices, this definition yields 
|A| = i122 T 1419 


as previously defined. 
When you use this definition to evaluate a determinant, you are expanding by 
cofactors in the first row. Example 3 demonstrates this procedure. 


EXAMPLE 3 The Determinant of a Matrix of Order 3 


Find the determinant of 


0 2 1 
A=|3 -1 2 |. 
4 0 1 
SOLUTION 


This is the same matrix as in Example 2. There you found the cofactors of the entries 
in the first row to be 


CQ,=—-l Cr = 5, Cy, =4 
So, by the definition of a determinant, you have 


Al Saag + Wale + aaCis First row expansion 
= 0(-1) + 2(5) + 1(4) 


= 14. | 


Although the determinant is defined as an expansion by the cofactors in the first row, 
it can be shown that the determinant can be evaluated by expanding in any row or column. 
For instance, you could expand the matrix in Example 3 in the second row to obtain 


[Al Stag Cog iis + ig Coy Second row expansion 
= 3(—2) + (—1)(—4) + 268) 
= 14 


or in the first column to obtain 


|A| = aCi Bg Gay Fa, First column expansion 
= O(— 1) + 3(—2) + 4(5) 
= 14. 


Try other possibilities to confirm that the determinant of A can be evaluated by 
expanding in any row or column. The theorem on the next page states this, and is 
known as Laplace’s Expansion of a Determinant, after the French mathematician Pierre 
Simon de Laplace (1749-1827). 
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TECHNOLOGY 
Many graphing utilities and 
software programs can 
find the determinant of 
a square matrix. If you use 
a graphing utility, then you may 
see something similar to the 
screen below for Example 4. 
The Technology Guide at 
CengageBrain.com can help 
you use technology to find a 
determinant. 


OOOW 
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THEOREM 3.1 Expansion by Cofactors 
Let A be a square matrix of order n. Then the determinant of A is 


det(A) = |A| = Sia,C, = aC, + apC +++ + aC, ith row 
Jal 


in~in A 
expansion 


z jth column 
det(A) = |A| = Sac. St ee oe ee a oe 


= expansion 


When expanding by cofactors, you do not need to find cofactors of zero entries, 
because zero times its cofactor is zero. 


aC = OC; 
= 0 


The row (or column) containing the most zeros is usually the best choice for expansion 
by cofactors. The next example demonstrates this. 


EXAMPLE 4 , The Determinant of a Matrix of Order 4 


Find the determinant of 


1 -2 3 0 

-1 1 0 2 

AS 0 2 0 3f 

3 4 0 =2 
SOLUTION 


Notice that three of the entries in the third column are zeros. So, to eliminate some of 
the work in the expansion, use the third column. 


|A| = 3(Ci3) + 0(C23) + O(C,,) + O(C,,) 


The cofactors C33, C33, and C43 have zero coefficients, so you need only find the 
cofactor C43. To do this, delete the first row and third column of A and evaluate the 
determinant of the resulting matrix. 


—1 1 2 
C = (71+; 0 2 3 Delete 1st row and 3rd column. 
3 4 -2 
=1 1 2 
=| 0 2 3 Simplify. 
3 4 -2 


Expanding by cofactors in the second row yields 


caso aoc aoc | 
= 0 + 2(1)X(-4) + 3(-1)(-7) 
= 13. 
You obtain 
|A| = 3(13) 


= 39, 
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An alternative method is commonly used to evaluate the determinant of a 3 x 3 
matrix A. To apply this method, copy the first and second columns of A to form fourth 
and fifth columns. Then obtain the determinant of A by adding (or subtracting) the 
products of the six diagonals, as shown in the diagram below. 


Subtract these three products. 


í a 


az, Ag) 


Add these three products. 


Confirm that the determinant of A is 


|A| = 41142233 F A443) + 413421433 — 431422413 T A322341; T 43321412 


EXAMPLE 5 The Determinant of a Matrix of Order 3 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


Find the determinant of 


o 8 4 

A=|3 -1 2l. 

4 -4 1 
SOLUTION 


Begin by copying the first two columns and then computing the six diagonal products 
as shown below. 


—4 0 6 E Subtract these products. 


Go I 12 < Add these products. 


Now, by adding the lower three products and subtracting the upper three products, you 
can find the determinant of A to be 


a =o wte | 


The diagonal process illustrated in Example 5 is valid only for matrices of order 3. 
For matrices of higher order, you must use another method. 


LINEAR Recall that a tetrahedron is a polyhedron consisting of four 
ALGEBRA triangular faces. One practical application of determinants is 
in finding the volume of a tetrahedron in a coordinate plane. 
APPLIED If the vertices of a tetrahedron are (X4, Ya; Z1), (Xo Yor Z2), 
(X3, Var Z3), aNd (X4, Yar Z4), then the volume is 


xy WY 4 
xX Yo 2 
X AR B 
X Va 7 


Volume = +det 


a — =) aa 


You will study this and other applications of determinants 
in Section 3.4. 


magnetix/Shutterstock.com 
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Upper Triangular Matrix 

ai) %2 43 +--+ An 
O a 3 ... An 
OREORE As, ... Gs, 
0 0 O coe a 


nn 


Lower Triangular Matrix 


a,, 0 Ora A 
a aA OR) 
a31 a32 433 0 
Gn) An2 an3 Ann 
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TRIANGULAR MATRICES 


Recall from Section 2.4 that a square matrix is upper triangular when it has all zero 
entries below its main diagonal, and lower triangular when it has all zero entries above 
its main diagonal, as shown in the diagram at the left. A matrix that is both upper and 
lower triangular is a diagonal matrix. That is, a diagonal matrix is one in which all 
entries above and below the main diagonal are zero. 

To find the determinant of a triangular matrix, simply form the product of the 
entries on the main diagonal. It should be easy to see that this procedure is valid for 
triangular matrices of order 2 or 3. For example, to find the determinant of 


2 i =] 
A=|0 -1 2 
0 0 3 


expand in the third row to obtain 


3. =] 
=] 2 


2 =] 


|A| = 0(=1)}+! | + 0(= 1871) 


= 3(1)(—2) 
= -6 


which is the product of the entries on the main diagonal. 


THEOREM 3.2 Determinant of a Triangular Matrix 


If A is a triangular matrix of order n, then its determinant is the product of the 
entries on the main diagonal. That is, 


det(A) = |A| = a; a433: ` ʻa 


PROOF 


Use mathematical induction* to prove this theorem for the case in which A is an upper 
triangular matrix. The proof of the case in which A is lower triangular is similar. If A 
has order 1, then A = [a,,] and the determinant is |A| = a,,. Assuming the theorem 
is true for any upper triangular matrix of order k — 1, consider an upper triangular 
matrix A of order k. Expanding in the kth row, you obtain 


|A| =0C,, + 0Co +- °° + OC, —1) F Ay Cy = Ag Cy: 


Now, note that C,, = (—1)*M,, = M, where M,, is the determinant of the upper 
triangular matrix formed by deleting the kth row and kth column of A. This matrix is of 
order k — 1, so apply the induction assumption to write 


|A| = ayMy. = Ay (Ay 142233 iai “ayi, 4-1) = Gy 933° * Akke m 


EXAMPLE 6 The Determinant of a Triangular Matrix 


The determinant of the lower triangular matrix 


2 0 0 0 


4 -2 0 0 
Aslea 6 i 4 
1 5 3 3 
is |A] = (2)(—2)(1)(3) = —12. T 


*See Appendix for a discussion of mathematical induction. 
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3 = 1 Exercises See CalcChat.com for worked-out solutions to odd-numbered exercises. 


The Determinant of a Matrix In Exercises 1-12, find 
the determinant of the matrix. 


1. [1] 2. [=3] 
ik JES 
s[e | s[i 53 
Ay f 
9. F l 10. E 3 


A-—3 2 A-2 0 
oo) ee 
Finding the Minors and Cofactors of a Matrix In 


Exercises 13-16, find all (a) minors and (b) cofactors of 
the matrix. 


1 2 —5 6 
13. | ! l 14. | i o] 
—3 2 1 =3 4 2 
15. 4 5 16. 6 3 1 
2 ,=3 1 4 -7 -8 
17. Find the determinant of the matrix in Exercise 15 


using the method of expansion by cofactors. Use (a) the 
second row and (b) the second column. 


18. Find the determinant of the matrix in Exercise 16 using 
the method of expansion by cofactors. Use (a) the third 


row and (b) the first column. 


5 3 0 6 3 0 7 0 
4 6 4 12 2 6 11 12 
aTe | a 2 -3 4 aB a 1 -1 2 
0 1-2 2 1 5 2 10 
w x y g 
21 —15 24 30 
a: —10 24 —32 18 
—40 22 32 —35 
w x y g 
10 15 —25 30 
m —30 20 -15 -10 
30 35 -25 -40 
5 2 0 0 -2 
0 1 4 3 2 
31./0 0 2 6 3 
0 0 3 4 1 
0 0 0 0 2 
—4 3 2 -1 -2 
1 -2 7 -13 -12 
32. | -6 2 -5 -6 -7 
0 0 0 0 0 
1 -4 -2 0 -9 


Finding a Determinant In Exercises 33 and 34, use 
the method demonstrated in Example 5 to find the 
determinant of the matrix. 


3 0 4 3 8 —-7 
33. | = 2 4 1 34. |0 -5 4 
I s3 1 8 1 6 


Finding a Determinant In Exercises 19-32, use P Finding a Determinant In Exercises 35-38, use a 


expansion by cofactors to find the determinant of 
the matrix. 


1 4 -2 3 =1 2 

19 3 2 0 20. 4 1 4 

al 4 3 =2 0 1 

2 4 6 =} 0 0 

21. | 0 3 1 22. 7 1l 0 

0 0 =5 1 2 2 
—0.4 04 03 0.1 02 0.3 
23.) 0.2 0.2 0.2 24. | -0.3 0.2 0.2 
0.3 0.2 0.2 0.5 04 04 

x y =] x y 1 

25. | 3 2. 0 26. | =2 =2 1 

1 1 1 1 5 1 


software program or a graphing utility to find the 
determinant of the matrix. 


© 37. 


a1 06 -03 ssi 
35. |0.7 -0.1 0.1 36. 
0.1 0.3 —0.8 ae o 
6 i 3 9 
1 2 -1 4 
0 1 2 -2 
0 3 2 =] 
i 2z 0 = 
8 5 1-2 0 
-1 0 7 1 6 
0 8 6 5 -3 
i 2 5 -8 4 
2 6-2 0 6 
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Finding the Determinant of a Triangular Matrix In 
Exercises 39-42, find the determinant of the triangular 
matrix. 


-2 0 0 4 0 0 
39’) 4 6 0 40./0 7 0 
-3 7 2 0 o0 -2 
5 8 -4 2 4 0 0 0 
0 0 6 0 -1 4 0 0 
Mg w a al Mls 3 s p 
0 0 o0 -1 -8 7 0 -2 


True or False? In Exercises 43 and 44, determine 
whether each statement is true or false. If a statement 
is true, give a reason or cite an appropriate statement 
from the text. If a statement is false, provide an example 
that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 
43. (a) The determinant of a 2x2 matrix A is 
yO T 411422: 
(b) The determinant of a matrix of order 1 is the entry 
of the matrix. 


(c) The ij-cofactor of a square matrix A is the matrix 
obtained by deleting the ith row and jth column of A. 


44. (a) To find the determinant of a triangular matrix, add 
the entries on the main diagonal. 


(b) To find the determinant of a matrix, expand by 
cofactors in any row or column. 


(c) When expanding by cofactors, you need not 
evaluate the cofactors of zero entries. 


Solving an Equation In Exercises 45-48, solve for x. 


x+3 2 x—6 3 
45. LEES =0 46. = a 0 
x=" 1 2 x+ 3 1 
47. eno 48. ti a17 


Solving an Equation In Exercises 49-52, find the 
values of A for which the determinant is zero. 


A+2 2 A-—5 3 
wt 7 s Doi 

À 2 0 A 0 1 
51.}0 A+1 2 52. |0 A 3 

0 1 A 2 2A-2 


53. Show that the system of linear equations 
AX, + a = b 
aX; + AyX, = by 
has the solution 


body, — biaz; 


ba» — ba 
— 142 a and = 
411492 ~ 21412 1472 T a21đ12 


when 4,14) — Gy), # 0. 
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54. CAPSTONE  Forann x n matrix A, explain 
how to find each value. 


(a) The minor M, of the entry a; 


(b) The cofactor Cj of the entry aj 
(c) The determinant of A 


Entries Involving Expressions In Exercises 55-62, 
evaluate the determinant, in which the entries are 
functions. Determinants of this type occur when changes 
of variables are made in calculus. 


6u —1 3x? —3y? 
55. | __ i 3p 56. 1 1 
ex ex ex xe~* 
a 2e”™ 3e% aB, —e™ (1 -— x)je™ 
x lnx x xInx 
a 1 1/x i 1 1+inx 
cos@ —rsin@ 0 l-v —u 0 
61. |sin@ rcos@ O| 62. wW(1—w) ul—w) —uv 
0 0 1 vw uw uv 


Verifying an Equation In Exercises 63-68, evaluate 
the determinants to verify the equation. 


63.” Y=- z 
y Z w x 
v4.” “aM 2 
y cz y z 
e.” H iM x + ew 
y z y ztcy 
66. |" *)=0 
cw cx 
1 x x 
67.1 y Yl =G-xK-vAE—») 
L g z 
1 1 di 
68&.|a b cl =(a-—b\b-—c\(c—alatb+c) 
E B æ 
69. You are given the equation 
x 0 c 
-1 x b| = ax? + bx +c. 
0 =1 a 


(a) Verify the equation. 


(b) Use the equation as a model to find a determinant 
that is equal to ax? + bx? + cx + d. 


70. The determinant of a 2 x 2 matrix involves two 
products. The determinant of a 3 x 3 matrix involves 
six triple products. Show that the determinant of a 
4 x 4 matrix involves 24 quadruple products. 
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3.2 Determinants and Elementary Operations 


J Use elementary row operations to evaluate a determinant. 
B Use elementary column operations to evaluate a determinant. 


H Recognize conditions that yield zero determinants. 


DETERMINANTS AND ELEMENTARY ROW OPERATIONS 


Which of the determinants below is easier to evaluate? 


i =-2 3 4 1-2 3 4 
4 -6 3 2 0 2 -9 -2 

Al = B| = 

I=), 4 -9 -3 % BIS 9 -3 -1 
3 -6 9 2 0 0 0 =1 


Given what you know about the determinant of a triangular matrix, it should be clear 
that the second determinant is much easier to evaluate. Its determinant is simply the 
product of the entries on the main diagonal. That is, |B| = (1)(2)(—3)(—1) = 6. 
Using expansion by cofactors (the only technique discussed so far) to evaluate the first 
determinant is messy. For example, when you expand by cofactors in the first row, you have 


=6 3 2 4 3 2 4 -6 2 4 -6 3 
Al) 4 -9 -3| +2|-2 -9 -3| +3|-2 4 -3|-1|-2 4 =O, 
-6 9 2 3 9 2 3 =6 2 3 =6 9 


Evaluating the determinants of these four 3 x 3 matrices produces 
|A| = (1)(—60) + (2)(39) + (3)(— 10) — (1)(— 18) = 6. 


Note that |A| and |B| have the same value. Also note that you can obtain matrix B from 
matrix A by adding multiples of the first row to the second, third, and fourth rows. 
(Verify this.) In this section, you will see the effects of elementary row (and column) 
operations on the value of a determinant. 


EXAMPLE 1 The Effects of Elementary Row 
Operations on a Determinant 


a. The matrix B is obtained from A by interchanging the rows of A. 


2 =3 1 4 
al =| =n and el =|; Jjl--u 
b. The matrix B is obtained from A by adding — 2 times the first row of A to the second 
row of A. 
1, =3 y =3 
Al = =? = = 
|A| i E and |B| fs | 2 


c. The matrix B is obtained from A by multiplying the first row of A by L, 
2 =g 1 -4 


-2 9 2 J=1 m 


In Example 1, notice that interchanging the two rows of A changes the sign of its 
determinant, adding — 2 times the first row of A to the second row does not change its 
determinant, and multiplying the first row of A by } multiplies its determinant by 5: The 
next theorem generalizes these observations. 


|A| = = and el = |_ 
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REMARK 


Note that the third property 
enables you to divide a row 
by the common factor. For 
example, 


Augustin-Louis Cauchy 
(1789-1857) 
Cauchy’s contributions to 
the study of mathematics 

were revolutionary, and 

he is often credited with 
bringing rigor to modern 
mathematics. For instance, 
he was the first to 
rigorously define limits, 
continuity, and the 
convergence of an infinite 
series. In addition to being 
known for his work in 
complex analysis, he 
contributed to the theories 
of determinants and 
differential equations. 

It is interesting to note 
that Cauchy’s work on 
determinants 
preceded 


Peel 


Cayley’s =e 
development ee 


of matrices. ops 


Factor 2 
E ; = ah Al out of 
3 T- 3 first row. 
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THEOREM 3.3 Elementary Row Operations and Determinants 


Let A and B be square matrices. 


. When B is obtained from A by interchanging two rows of A, det(B) = — det(A). 

. When B is obtained from A by adding a multiple of a row of A to another 
row of A, det(B) = det(A). 

. When B is obtained from A by multiplying a row of A by a nonzero constant c, 
det(B) = c det(A). 


PROOF 


The proof of the first property is below. The proofs of the other two properties are left as 
exercises. (See Exercises 47 and 48.) Assume that A and B are 2 x 2 matrices 


j= a ind B= |% a 


44, an2 âi Ay 


Then, you have |A| = a,,45, — a4 and |B| = a,,a,, — a43. So |B| = -JA]. 
Using mathematical induction, assume the property is true for matrices of order (n — 1). 
Let A be an n x n matrix such that B is obtained from A by interchanging two rows of 
A. Then, to find |A| and |B|, expand in a row other than the two interchanged rows. By 
the induction assumption, the cofactors of B will be the negatives of the cofactors of A 
because the corresponding (n — 1) x (n — 1) matrices have two rows interchanged. 
Finally, |B| = — |A| and the proof is complete. 


Theorem 3.3 provides a practical way to evaluate determinants. To find the 
determinant of a matrix A, you can use elementary row operations to obtain a 
triangular matrix B that is row-equivalent to A. For each step in the elimination process, use 
Theorem 3.3 to determine the effect of the elementary row operation on the determinant. 
Finally, find the determinant of B by multiplying the entries on its main diagonal. 


EXAMPLE 2 


Find the determinant of 


Finding a Determinant Using 
Elementary Row Operations 


0 -7 14 
A= ]1 2 =2'|. 
0 3: =8 
SOLUTION 
Using elementary row operations, rewrite A in triangular form as shown below. 
0 -7 14 1 2 -2| ~ 
I 2 -21=-lo -7 14| œ Interchange the first two rows. 
0 3-8 0 3 -=8 
1 2 = 2, 
= 7/0 1 —2| <= Factor —7 out of the second row. 
0 3 =8 
1 2 =2 
a ge — Add ~3 times the second th 
0 0 -2 d —3 times the second row to the 


third row to produce a new third row. 


The above matrix is triangular, so the determinant is 
JA] = 7(1)(1)(-2) = 14. Lu 


SSPL/Getty Images 
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DETERMINANTS AND ELEMENTARY COLUMN OPERATIONS 


Although Theorem 3.3 is stated in terms of elementary row operations, the therem 
remains valid when the word “column” replaces the word “row.” Operations 
performed on the columns (rather than on the rows) of a matrix are elementary column 
operations, and two matrices are column-equivalent when one can be obtained from 
the other by elementary column operations. Here are illustrations of the column versions 
of Theorem 3.3 Properties 1 and 3. 


2 1 -3 1 2. =3 
4 0 ıil=-0 4 1 
0 0 2 0 0 2 
2 3. =9 1 3. =5 
4 1 0 = 2] 2 1 (0) 
-2 4 -3 -1 4 -3 


Factor 2 out of the first column. 


In evaluating a determinant, it is occasionally convenient to use elementary column 
operations, as shown in Example 3. 


A] Finding a Determinant Using Elementary 
EXAMPLE 3 Column Operations 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


=] 2 2 
Find the determinant of A = 3 -=6 4|. 
5 -10 =3 


SOLUTION 


The first two columns of A are multiples of each other, so you can obtain a column of 
zeros by adding 2 times the first column to the second column, as shown below. 


-1 2 2 |-1 o 2 
3 -6 4 =| 3 0 4 
5-10 -3 5 0 -3 


At this point, you do not need to rewrite the matrix in triangular form, because there is 
an entire column of zeros. Simply conclude that the determinant is zero. The validity 
of this conclusion follows from Theorem 3.1. Specifically, by expanding by cofactors 
in the second column, you have 


|A] = (0)C,, + (0)Cy + (0)C3, = 0. 


LINEAR In a Sudoku puzzle, the object is to fill out a partially 
ALGEBRA completed 9 x 9 grid of boxes with numbers from 1 to 9 
so that each column, row, and 3 x 3 sub-grid contains each 
APPLIED number once. For a completed Sudoku grid to be valid, no 
two rows (or columns) will have the numbers in the same 
order. If this should happen, then the determinant of the 
9 x 9 matrix formed by the numbers will be zero. This is a 
direct result of condition 2 of Theorem 3.4 on the next page. 


iStockphoto.com/jirkaejc 
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MATRICES AND ZERO DETERMINANTS 


Example 3 shows that when two columns of a matrix are scalar multiples of each 
other, the determinant of the matrix is zero. This is one of three conditions that yield 
a determinant of zero. 


THEOREM 3.4 Conditions That Yield a Zero Determinant 


If A is a square matrix and any one of the conditions below is true, then det(A) = 0. 


1. An entire row (or an entire column) consists of zeros. 
2. Two rows (or columns) are equal. 
3. One row (or column) is a multiple of another row (or column). 


PROOF 


Verify each part of this theorem by using elementary row operations and expansion by 
cofactors. For instance, if an entire row or column consists of zeros, then each cofactor 
in the expansion is multiplied by zero. When condition 2 or 3 is true, use elementary 

row or column operations to create an entire row or column of zeros. | 


Recognizing the conditions listed in Theorem 3.4 can make evaluating a 
determinant much easier. For example, 


0 0 0 T =? 4 1 2 ie 
2 4 -5|=0, JO 1 2| = 0, 2 -1 O =0. 
3 =5 2 1 =? 4 =2 0 6 


The third column is a 
multiple of the first column. 


The first row 
has all zeros. 


The first and third 
rows are the same. 


Do not conclude, however, that Theorem 3.4 gives the only conditions that produce 
a zero determinant. This theorem is often used indirectly. That is, you may begin with a 
matrix that does not satisfy any of the conditions of Theorem 3.4 and, through elementary 
row or column operations, obtain a matrix that does satisfy one of the conditions. 
Example 4 demonstrates this. 


EXAMPLE 4 A Matrix with a Zero Determinant 


Find the determinant of 


1 4 1 
A=|2 -1 0}. 
0 18 4 
SOLUTION 
Adding —2 times the first row to the second row produces 
1 4 1 
lA] = ]2 + (—2)0) -1 + (—2)(4) 0 + (—2)(0) 
0 18 
1 4 1 
=|/0 =9 2). 
0 18 4 


The second and third rows are multiples of each other, so the determinant is zero. a 
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In Example 4, you could have obtained a matrix with a row of all zeros by 
performing an additional elementary row operation (adding 2 times the second row 
to the third row). This is true in general. That is, a square matrix has a determinant of 
zero if and only if it is row- (or column-) equivalent to a matrix that has at least one 
row (or column) consisting entirely of zeros. 

You have now studied two methods for evaluating determinants. Of these, the 
method of using elementary row operations to reduce the matrix to triangular form is 
usually faster than cofactor expansion along a row or column. If the matrix is large, 
then the number of arithmetic operations needed for cofactor expansion can become 
extremely large. For this reason, most computer and calculator algorithms use the 
method involving elementary row operations. The table below shows the maximum 
numbers of additions (plus subtractions) and multiplications (plus divisions) needed for 
each of these two methods for matrices of orders 3, 5, and 10. (Verify this.) 


Cofactor Expansion Row Reduction 
Order n | Additions Multiplications | Additions Multiplications 
3 5 9 8 10 
5 119 205 40 44 
10 3,628,799 6,235,300 330 339 


In fact, the maximum number of additions alone for the cofactor expansion of 
an n x n matrix is n! — 1. The factorial 30! is approximately equal to 2.65 x 1032, 
so even a relatively small 30 x 30 matrix could require an extremely large number of 
operations. If a computer could do one trillion operations per second, it could still take 
more than 22 trillion years to compute the determinant of this matrix using cofactor 
expansion. Yet, row reduction would take only a fraction of a second. 

When evaluating a determinant by hand, you sometimes save steps by using 
elementary row (or column) operations to create a row (or column) having zeros in all 
but one position and then using cofactor expansion to reduce the order of the matrix 
by 1. The next two examples illustrate this approach. 


EXAMPLE J Finding a Determinant 


Find the determinant of 


-3 5 2 
A=| 2 -4 ~-1l. 
-3 0 6 


SOLUTION 


Notice that the matrix A already has one zero in the third row. Create another zero in 
the third row by adding 2 times the first column to the third column, as shown below. 


=n 5 2 —3 5 —4 
|A| =| 2 4 lj =| 2 4 3 
=3 0 6 =3 0 0 
Expanding by cofactors in the third row produces 
i 5 —4 
a= 2 -4 3f)=-3(-14_ 7G) = -30(-) =3 
<3—_9—9 Lal 
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EXAMPLE 6 Finding a Determinant 


Find the determinant of 


2 0 1 3 = 2 
=2 1 3 2 =i 
A= 1 0. =i 2 3 |. 
3 =l 2 4 -3 
1 1 3 2 0 
SOLUTION 


The second column of this matrix already has two zeros, so choose it for cofactor 
expansion. Create two additional zeros in the second column by adding the second row 
to the fourth row, and then adding — 1 times the second row to the fifth row. 


2 0 1 3 =2 


= 7 3 2 -=i 
AĮAļ=| 1 0 -1 2 3 
3 -1 2 4 -3 
i 1 3 2 0 
2 ù i @ =p 

= 132 
=| 1 =} & 4 
1 5 6 -4 
3 0 0 1 
3 i 3 =2 
I -1 2 3 

= _1)4 

(1(— 1) i 5 6 —4 


3 0 0 1 


You have now reduced the problem of finding the determinant of a5 x 5 matrix to the 
problem of finding the determinant of a 4 x 4 matrix. The fourth row already has two 
zeros, so choose it for the next cofactor expansion. Add —3 times the fourth column 
to the first column. 


2 1 3 =2 8 1 3 = 
|A] = 1. =] 2 3}. |-8 -I1 2 
1 6 —4 13 5 6 4 
3 0 0 1 o—eo— e—a} 
8 1 3 
= (1)(-1)8]-8 -1 2 
13 5 6 
Add the second row to the first row and then expand by cofactors in the first row. 
8 tf 3) |e —e—a5h 
|AJ=|-8 -1 2)=|-8 -1 
13 5 6 13 5 
=8 =I 
= s5(—1)4 
ISN 13 5 
= 5(1)(—27) 


Ss | 
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3 S 2 Exe rcises See CalcChat.com for worked-out solutions to odd-numbered exercises. 


Properties of Determinants In Exercises 1-20, 
determine which property of determinants the equation 
illustrates. 


2 -6 -4 5 
il “| -0 a 
1 4 2 -3 2 1 
3.10 0 ol=0 4.| 6 0 0 =0 
5 6 -7 -3 2 1 
1 3 4 1 4 3 
5.|-7 2 -5}=-|-7 -5 2 
6 1 2 6 2 1 
1 3 4 -5 1 6 2 -7 
6 (72 2 9 Jap 2 0 1 
1i 6 2 -7 1 3 4 -5 
0 5 3 8 o 5 3 8 
5 10 1 2 
Mo |=); a 
9 1 3 1 
el, o=o | 
1 8 -3 1 2-1 
9. |3 -12 6/=12/3 -3 2 
7 4 9 7 1 3 
1 2 3 r 1 1l 
10. |4 -8 6l =6ļ4 -4 2 
5 4 12 5 2 4 
-10 5 5 -2 1 1 
11. | 35 —20 25)=53} 7 -4 5 
0 15 30 0 3 6 
6 0 0 0 1 0 0 0 
0o 6 0 o „0 1 0 0 
ta o e d flo o i ad 
0 0 0 6 0 0 0 1 
2 -3/ |2 -3 
13. ig J-i 19 
2 to 1 
tey a=k 1 
1 -3 2 1 -3 2 
15.| 5 2 -1/=| 0 17-11 
-1 0 6 |-1 0 6 
3 2 4 1l 3 2-6 1l 
g2 1 5 ön 1 0 6 
“| 5 -7-20 15 5 -7 15 15 
4 -1 13 12 4 -1 8 12 


5 4. 2 5 4 2 
17.4 -3 4 =-|-4 3 -4 
7 6 3 7 6 
3 2 -2 3 2 -2 
18. |-1 0 3)/=-| 4 2 0 
4 2 0 -1 0 3 
2 1-1 0 4 
i 0 1 3 2 
9%} 3 6 1 -3  6/=0 
0 4 0 2 0 
-1 8 5 3 2 
4 3 1 9 9 
9 -l 2 3 -3 
2./3 4 6 9 12/=0 
5 2 0 6 6 
6 0 3 0 0 


Finding a Determinant In Exercises 21-24, use either 
elementary row or column operations, or cofactor 
expansion, to find the determinant by hand. Then use 
a software program or a graphing utility to verify 
your answer. 


1 0 2 =j 3 2 
21. |-1 1 4 22. | 0 2 
2 0 3 1 1 -1 
3 1 0 1 3 2 1 1 
1 0 =k =] =] 0 2 0 
a= 2 0 1 2 an 4 p =] 0 
=] 0 3 1 3 1 1 0 


Finding a Determinant In Exercises 25-36, use 
elementary row or column operations to find the 
determinant. 


1 7 =3 1 1 1 
25. |1 3 1 26. |2 -1 -2 
4 8 1 I =2 =1 
2 =1 =! 3 0 6 
27. 1 3 2 28. |2 -3 4 
—6 3 3 | =2 2 
3 2 =3 3 8 =7 
29. | 7 5 1 30. 0 -5 4 
=] 2 6 6 1 6 
4 -7 9 1 9 —4 2 5 
6 2 7 0 2 7 6 —-5 
k 3 6 =3 3 = 4 l =2 0 
0 7 4 -1 7 3 4 10 
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1 -2 7 9 
3 -4 5 5 
ans 3 6 1 -1l 
4 5 3 2 
0 —-4 9 3 
9 2 =2 7 
ai =5 7 0 Ill 
=8 0 0 16 
1 =] 8 4 2 
2 6 0 —4 3 
35. |2 0 2 6 2 
0 2 8 0 0 
0 1 1 2 2 
3s =2 4 3 1 
=] 0 2 1 0 
36. >. =l 0 3 2 
4 T =$ 0 0 
1 2 3 0 2 


True or False? In Exercises 37 and 38, determine 
whether each statement is true or false. If a statement 
is true, give a reason or cite an appropriate statement 
from the text. If a statement is false, provide an example 
that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


37. (a) Interchanging two rows of a square matrix changes 
the sign of its determinant. 


(b) Multiplying a column of a square matrix by a 
nonzero constant results in the determinant being 
multiplied by the same nonzero constant. 


(c) If two rows of a square matrix are equal, then its 
determinant is 0. 


38. (a) Adding a multiple of one column of a square matrix 
to another column changes only the sign of the 
determinant. 


(b) Two matrices are column-equivalent when one 
matrix can be obtained by performing elementary 
column operations on the other. 


(c) If one row of a square matrix is a multiple of another 
row, then the determinant is 0. 


Finding the Determinant of an Elementary Matrix In 
Exercises 39-42, find the determinant of the 
elementary matrix. (Assume k # 0.) 


1 0 0 0 0 1 

39. | 0 k 0 40. | 0 1 0 
0 0 1 1 0 0 

1 0 0 1 0 0 

41. | k 1 0 42. | 0 1 0 
0 1 0 k 1 
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43. Proof Prove the property. 
(ay, T bi) ai2 413 
Q an an| + |b an an| = (a + by) an a3 


(azı T bz,) a32 33 


a&i i2 i3 bi ap 443 


a31 32 33 b31 a32 33 


44. Proof Prove the property. 


ita 1 1 r 
aes: I = abi +t t+ 4) 
1 l ite a E 


a#0, b#0, c#0 


45. Find each determinant. 


cos @ sin @ 
—sin@ cos@ 


sin 0 3 


| (b) 1 sind 


(a) | 


46. CAPSTONE Evaluate each determinant 
when a = 1,b = 4, and c = —3. 


a 0 1 
(a) (b) JO Cc 0 
b 0 —16 


47. Guided Proof Prove Property 2 of Theorem 3.3: 
When B is obtained from A by adding a multiple of a 
row of A to another row of A, det(B) = det(A). 


Getting Started: To prove that the determinant of B is 
equal to the determinant of A, you need to show that 
their respective cofactor expansions are equal. 


(i) Begin by letting B be the matrix obtained by adding 
c times the jth row of A to the ith row of A. 


(ii) Find the determinant of B by expanding in this 
ith row. 


(iii) Distribute and then group the terms containing 
a coefficient of c and those not containing a 
coefficient of c. 


(iv) Show that the sum of the terms not containing a 
coefficient of c is the determinant of A, and the 
sum of the terms containing a coefficient of c is 
equal to 0. 

48. Guided Proof Prove Property 3 of Theorem 3.3: 
When B is obtained from A by multiplying a row of A 
by a nonzero constant c, det(B) = c det(A). 

Getting Started: To prove that the determinant of B is 

equal to c times the determinant of A, you need to show 

that the determinant of B is equal to c times the cofactor 

expansion of the determinant of A. 

(i) Begin by letting B be the matrix obtained by 
multiplying c times the ith row of A. 

(ii) Find the determinant of B by expanding in this 

ith row. 


(iii) Factor out the common factor c. 


(iv) Show that the result is c times the determinant of A. 
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3.3 Properties of Determinants 


Find the determinant of a matrix product and a scalar multiple of 
a matrix. 


Find the determinant of an inverse matrix and recognize equivalent 
conditions for a nonsingular matrix. 


| Find the determinant of the transpose of a matrix. 


MATRIX PRODUCTS AND SCALAR MULTIPLES 


In this section, you will learn several important properties of determinants. You will 
begin by considering the determinant of the product of two matrices. 


EXAMPLE 1 The Determinant of a Matrix Product 


Find |A|, |B|, and |AB| for the matrices 
1 =2 2 2 0 1 
A= {0 3 2| and B=|0 -1 -2]. 
1 0 1 3 1 =2 
SOLUTION 
|A| and |B| have the values 
D =2 2 2 0 1 
lAl=|0 3 2ļ=-7 and |B) =o -1 -2 =11. 
1 0 1 3 1 =2 


The matrix product AB is 


I =2 2||2 0 1 8 4 1 
AB =1|0 3 200 -1 =2|=|6 —-1 —10}. 


Finally, 
REMARK 8 4 1 
Theorem 3.5 can be extended |AB| = |6 -1 -10| = —77. 
to include the product of any 5 i =j | 


finite number of matrices. 


mess In Example 1, note that |AB| = |A||B 


,or —77 = (—7)(11). This is true in general. 
|A,A,A3° ` ` Aql 
= |A,||Aa||Asl > > + [Ad THEOREM 3.5 Determinant of a Matrix Product 


If A and B are square matrices of order n, then det(AB) = det(A) det(B). 


PROOF 
To begin, observe that if E is an elementary matrix, then, by Theorem 3.3, the next three 
statements are true. If you obtain E from J by interchanging two rows, then |E| = — 1. 


If you obtain E by multiplying a row of J by a nonzero constant c, then |E| = c. 
If you obtain E by adding a multiple of one row of Z to another row of J, then |E| = 1. 
Additionally, by Theorem 2.12, if E results from performing an elementary row 
operation on J and the same elementary row operation is performed on B, then the 
matrix EB results. It follows that |EB| = |E| |B]. 
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This can be generalized to conclude that |E,- - - EE B| = |E,|- - - |E,||£,||Bl. 
where E; is an elementary matrix. Now consider the matrix AB. If A is nonsingular, 
then, by Theorem 2.14, it can be written as the product A = E,: - - E,E,, and 


|AB| = |E: ` - E,E,B| 


= |E- + + [EE |lB| 
E |E: ` - E,E,||B| 
= |A][B]. 


If A is singular, then A is row-equivalent to a matrix with an entire row of zeros. 
From Theorem 3.4, A| = 0. Moreover, it follows that AB is also singular. (If AB were 
nonsingular, then A[B(AB)~'] = Z would imply that A is nonsingular.) So, |AB| = 0, 
and you can conclude that |AB| = |A||B]. 


The next theorem shows the relationship between |A| and |cA]. 


THEOREM 3.6 Determinant of a Scalar Multiple of a Matrix 


If A is a square matrix of order n and c is a scalar, then the determinant of cA is 


det(cA) = c” det(A). 


PROOF 
This formula can be proven by repeated applications of Property 3 of Theorem 3.3. 
Factor the scalar c out of each of the n rows of |cA| to obtain |cA| = c”|A]. | 


——— The Determinant of a Scalar 
See Multiple of a Matrix 


Find the determinant of the matrix. 


10 —20 40 
A=| 30 0 50 
-20 -30 10 
SOLUTION 
1 -2 4 i “<2. a 
A=10i 3 0 5| and |3 0 5/=5 
-2 -3 1l =3 =3 ] 


so apply Theorem 3.6 to conclude that 


1 =2 4 
|A| = 107) 3 0 5| = 1000(5) = 5000. 


=2. =3 1 | 


Theorems 3.5 and 3.6 give formulas for the determinants of the product of two 
matrices and a scalar multiple of a matrix. These theorems do not, however, give a 
formula for the determinant of the sum of two matrices. The sum of the determinants 
of two matrices usually does not equal the determinant of their sum. That is, in general, 
|A| + |B| # |A + B|. For example, if 


6 2 3 T 
a=|5 A and e-(5 || 


then |A| = 2 and |B| = —3, but A + B= > | and |A + B| = —18. 
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DISCOVERY 


Let 


Use a software 
program ora 
graphing utility 
to find A". 


Compare det(A~') with 
det(A). 


Make a conjecture 
about the determinant 
of the inverse of 

a matrix. 


DETERMINANTS AND THE INVERSE OF A MATRIX 


It can be difficult to tell simply by inspection whether a matrix has an inverse. Can you 
tell which of the matrices below is invertible? 


0 Z% =l 0 2 =] 
A=|3 -2 1} or B=]|3 -2 1 
3 2 =] 3 2 1 


The next theorem suggests that determinants are useful for classifying square matrices 
as invertible or noninvertible. 


THEOREM 3.7 Determinant of an Invertible Matrix 


A square matrix A is invertible (nonsingular) if and only if det(A) # 0. 


PROOF 


To prove the theorem in one direction, assume A is invertible. Then AA~! = J, and 
by Theorem 3.5 you can write |A||A~!| = |Z|. Now, |Z| = 1, so you know that neither 
determinant on the left is zero. Specifically, |A| # 0. 

To prove the theorem in the other direction, assume the determinant of A is nonzero. 
Then, using Gauss-Jordan elimination, find a matrix B, in reduced row-echelon form, 
that is row-equivalent to A. The matrix B must be the identity matrix / or it must have 
at least one row that consists entirely of zeros, because B is in reduced row-echelon 
form. But if B has a row of all zeros, then by Theorem 3.4 you know that |B| = 0, 
which would imply that |A| = 0. You assumed that |A| is nonzero, so you can conclude 
that B = I. The matrix A is, therefore, row-equivalent to the identity matrix, and by 
Theorem 2.15 you know that A is invertible. | 


Classifying Square Matrices 
EXAMPLE 3 as Singular or Nonsingular 


Determine whether each matrix has an inverse. 


0 2 =1 0 2 =1 
ae |S =2 1 b |3 =2 1 

3 2. =l 3 2 1 
SOLUTION 

0 2 =] 
a3 =2 1; =0 

3 2 =] 


so this matrix has no inverse (it is singular). 


0 2 =] 
Dir |3 =2 1} = -—12 40 
3 2 1 
so this matrix has an inverse (it is nonsingular). a 


The next theorem provides a way to find the determinant of an inverse matrix. 


THEOREM 3.8 Determinant of an Inverse Matrix 


o 1 
~ det(A) 


If A is ann x n invertible matrix, then det(A~!) 
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REMARK 


The inverse of Ais 


| 
= 
ll 

Nie = NIA 
| 

Bis NIW Aw 
| 

Bis NIA BIW 


Evaluate the determinant 

of this matrix directly. Then 
compare your answer with 
that obtained in Example 4. 


REMARK 


In Section 3.2, you saw that 

a square matrix A has a 
determinant of zero when A is 
row-equivalent to a matrix that 
has at least one row consisting 
entirely of zeros. The validity 
of this statement follows from 
the equivalence of Statements 
4 and 6. 
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PROOF 


The matrix A is invertible, so AA~! = J, and using Theorem 3.5, |A||A~!| = [Z| = 1. 
By Theorem 3.7, you know that |A| # 0, so you can divide each side by |A| to obtain 


1 
=1| = — 


EXAMPLE 4 The Determinant of the Inverse of a Matrix 


Find |A~'| for the matrix 


1 0 3 
A=|0 -1 2|. 
2 1 0 


SOLUTION 


One way to solve this problem is to find A~! and then evaluate its determinant. It is 
easier, however, to apply Theorem 3.8, as shown below. Find the determinant of A, 


1 0 3 
|AJ=]o -1 2)=4 
2 1 0 
and then use the formula |A~!| = 1/|A| to conclude that |A~!| = 3. 


Note that Theorem 3.7 provides another equivalent condition that can be added to 
the list in Theorem 2.15, as shown below. 


Equivalent Conditions for a Nonsingular Matrix 


If A is ann x n matrix, then the statements below are equivalent. 


. A is invertible. 

. Ax = b has a unique solution for every n x 1 column matrix b. 
. Ax = O has only the trivial solution. 

. A is row-equivalent to /,. 

. A can be written as the product of elementary matrices. 

. det(A) # 0 


EXAM PLE 5 Systems of Linear Equations 


Which of the systems has a unique solution? 


a. 2X, —X,= —1 b. 2X_ —X,= —1 
3x, = 2%, +x%,= 4 3x, —2x%, +x,= 4 
3x, + 2x, — x, = —4 3x, + 2x, + x, = —4 

SOLUTION 


From Example 3, you know that the coefficient matrices for these two systems have the 
determinants shown below. 


0 2.1 0 oa | 
a. |3 -2 1| =0 b. |3 -2 1| = -12 
3 2 =i 3 2 1 


Using the preceding list of equivalent conditions, you can conclude that only the 
second system has a unique solution. 
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DETERMINANTS AND THE TRANSPOSE OF A MATRIX 


The next theorem tells you that the determinant of the transpose of a square matrix 
is equal to the determinant of the original matrix. This theorem can be proven using 
mathematical induction and Theorem 3.1, which states that a determinant can be 
evaluated using cofactor expansion in a row or a column. The details of the proof are 
left to you. (See Exercise 66.) 


THEOREM 3.9 Determinant of a Transpose 


If A is a square matrix, then 


det(A) = det(A”). 


EXAMPLE 6 The Determinant of a Transpose 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


Show that |A| = |A”| for the matrix below. 


3 1 =2 
A=] 2 0 0 
—4 -l1 5 
SOLUTION 
To find the determinant of A, expand by cofactors in the second row to obtain 
I =2 
= 2(—1)3 
Al HUI. s 


| 
| 
oa 


To find the determinant of 


3 2 -4 
AT = 1 0 -1 
=2 0 5 


expand by cofactors in the second column to obtain 
=} | 


T| = —1)3 
|[A"] = 2(- 1) P 


1 
-2 
= (2)(—1)(3) 
Sh ul 


LINEAR Systems of linear differential equations often arise in 
ALGEBRA engineering and control theory. For a function f(t) that is 
defined for all positive values of t, the Laplace transform 


APPLIED of f(t) is 


F(s) = Í e “F(t)dt 
0 

provided that the improper integral exists. Laplace 

transforms and Cramer's Rule, which uses determinants 

to solve a system of linear equations, can sometimes be 

used to solve a system of differential equations. You will 

study Cramer's Rule in the next section. 


William Perugini/Shutterstock.com 
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The Determinant of a Matrix Product In Exercises 
1-6, find (a) |A|, (b) |B|, (c) AB, and (d) |AB|. Then 
verify that |A||B| = |AB|. 


= 2 1 1 1 
aa 3h @=[5 i 


3 4 i 
nasl, | a= (2 | 
-1 2 1 -1 0 0 
3 AS) 1 0 1k B=| 0 2 0 
0O i 0 0 0 3 
2 1 3 =j 4 
4A=]1 -1 2|, B=|0 1 3 
3 0 3-2 1 
2 0 1 1 i 0-1 1 
1 -1 0 1 2 č 0 2 
a 3 1 of 25fi 1-1 0 
1 2 3 0 3 2 1 0 
2 A p g 
i=? ft J 
aaa 0 2 If 
1-1 1 0 
6 1-1 0 
=f 2 i 1 
B=) ò o 1 2 
0 0 O-1 


The Determinant of a Scalar Multiple of a Matrix 
In Exercises 7-14, use the fact that |cA| = c”|A| to 
evaluate the determinant of the n x n matrix. 


5 15 21 | 
ea E E ea Be P) 


-3 6 9 4 16 
9A=| 6 9 12| 10A=/12 -8 8 
9 12 15 16 20 —4 
2 -4 6 40 25 10 
11.A=|-4 6 -8| 12A=|/30 5 20 
6 -8 10 15 35 45 
5 0-15 0 
0 5 0 0 
ae -10 0 5 O 
0-20 0 5 
0 16 -8 -32 
iwas 2 He 16 


The Determinant of a Matrix Sum In Exercises 15-18, 
find (a) |A], (b) |B|, (© A + B, and (d) |A + B|. Then 
verify that |A| + |B| # |A + B|. 


=] 1 | =f 
iia oh a-[_2 “ol 


=] 1 2 1 0 1 
17. A= 1 1}, B=)-1 1 2 
1 1 =] 1 2 
0 1 2 0 = 
18.A=]1 -1 O|, B= |2 
2 1 0 


Classifying Matrices as Singular or Nonsingular 
In Exercises 19-24, use a determinant to decide whether 
the matrix is singular or nonsingular. 


5 4 3 -6 
19. f i s 20. | i s] 

1 3 

2 2 2 14 5 q 
21.|$ -; 0 22. |-15 0 3 

1 1 1 1 -5 -10 

1 0 -8 2 0.8 0.2 —0.6 0.1 

0 8 -1 10 -12 06 06 0 
3-19 o o 1| “| 07-03 01 0 

o 0 0 2 0.2 -03 06 0 


The Determinant of the Inverse of a Matrix 
In Exercises 25-30, find |A7!|. Begin by finding A™, 
and then evaluate its determinant. Verify your result 
by finding |A| and then applying the formula from 


1 
Theorem 3.8, |A~!| = = 


[AT 
2 3 1 -2 
Aah J %. a=]; z 
2 -2 3 1 0 1 
27.A=|1 -1 2| 28A=|2 -1 2 
3 0 3 1 -2 3 
1 0-1 3 
1 0 3 -2 
2.A=|, 9 5 4 
1-3 1 2 
0 1 0 3 
I -2 -3 1 
Al e 
1 -2 -4 1 
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(x 35. 2x, + x, + 5x, + X= 


© 36. Nyy hh: ky 
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System of Linear Equations In Exercises 31-36, use the AB Finding Determinants In Exercises 51-56, use a 


determinant of the coefficient matrix to determine whether 
the system of linear equations has a unique solution. 


31. x, — 3x, =2 32. 3x, — 4x, = 2 
2x, + X= 4, — bn = 1 


34. x, + x - 4 =4 


x, + xX, = 3x, = Ak = 
2X, + 2X, + 2x3 — 3x4 = 
HF Sx = = 


W Ne 


x, =0 
a — x3 — xX, = 0 
xX +%+x,-x%, =0 
xX, t+ my +x, 4+%,=6 


Singular Matrices In Exercises 37-42, find the value(s) 
of k such that A is singular. 


k-1 3 k-1 2 
mafi 3) af 2] 
1 0 3 1 k 2 
39.A=|2 -1 of 40.A=/-2 0 -k 
4 2 k 3 1 -4 
0 k 1 k -3 -k 
4. A=|k 1 k| 42A=/-2 k 1 
1 k 0 k 1 0 


Finding Determinants In Exercises 43-50, find 
(a) |A7|, (b) |A?|, (c) [AAT], (d) |2A], and (e) |A7!]. 


6 -11 -4 10 
ma T] wafe 
5 0 0 1 5 4 
45.A=|1 -3 0 46.A=|0 -6 2 
i =1 2 0 0 =3 
2 0 5 4 1 9 
47.A=|4 -1 6 48.A=|-1 0 -2 
5. 2 Ff -3 3 0 
-3 0 0 0 
0 2 0 0 
AS! oag 
0 0 0 5 
2 0 0 1 
0-3 0 0 
AG 0 4 0 
1 0 0 1 


software program or a graphing utility to find (a) |A], 
(b) |A7|, (© |A?|, (d) |2A], and (e) |A7?]. 


51. A= È z] 52. A= E ;| 


3 i =2 
53. A= 2 =1 3 
=3 1 2 
3 2 1 
4 3 4 
2 1 
54. = 3 1 3 
=I T 3 
4 3 4 
=2 1 5 
3 =] 0 
6 5 1-1 
2 4 3 5 
© 56. 4 = E oo 
2 2 1 3 


57. Let A and B be square matrices of order 4 such that 
|A| = —5 and |B| = 3. Find (a) |A?|, (b) |B?|, (©) |A? 
and (d) |B]. 


š 


58. CAPSTONE Let A and B be square matrices 
of order 3 such that |A| = 4 and |B| = 5. 


(a) Find |AB|. 


(b) Find |2A]. 

(c) Are A and B singular or nonsingular? Explain. 
(d) If A and B are nonsingular, find |A~!| and |B7}]. 
(e) Find |(AB)"]. 


59. Proof Let A and B be nxn matrices such that 
AB = I. Prove that |A| # 0 and |B| # 0. 


60. Proof Let A and B be n x n matrices such that AB 
is singular. Prove that either A or B is singular. 


61. Findtwo2 x 2 matrices such that |A| + |B| = |A + B]. 
62. Verify the equation. 


a+b a a 
a a+b a| = b?(3a + b) 
a a a+b 


63. Let A be an n x n matrix in which the entries of each 
row sum to zero. Find |A]. 


64. Illustrate the result of Exercise 63 with the matrix 


2-=1 = 
A= |-3 1 2 |. 
0 -2 2 
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65. Guided Proof Prove that the determinant of an 
invertible matrix A is equal to +1 when all of the entries 
of A and A~! are integers. 


Getting Started: Denote det(A) as x and det(A~!) as y. 
Note that x and y are real numbers. To prove that det(A) 
is equal to +1, you must show that both x and y are 
integers such that their product xy is equal to 1. 


(i) Use the property for the determinant of a matrix 
product to show that xy = 1. 


(ii) Use the definition of a determinant and the fact that 
the entries of A and A`! are integers to show that 
both x = det(A) and y = det(A7!) are integers. 

(iii) Conclude that x = det(A) must be either 1 or —1 
because these are the only integer solutions to the 
equation xy = 1. 

66. Guided Proof Prove Theorem 3.9: If A is a square 
matrix, then det(A) = det(A”). 

Getting Started: To prove that the determinants of A 

and A? are equal, you need to show that their cofactor 

expansions are equal. The cofactors are + determinants 
of smaller matrices, so you need to use mathematical 
induction. 


(i) Initial step for induction: If A is of order 1, then 
A = [a,,] = A” 
so 
det(A) = det(A’?) = ayy. 

(ii) Assume the inductive hypothesis holds for all 
matrices of order n — 1. Let A be a square matrix 


of order n. Write an expression for the determinant 
of A by expanding in the first row. 


(iii) Write an expression for the determinant of A’ by 
expanding in the first column. 

(iv) Compare the expansions in (ii) and (iii). The 
entries of the first row of A are the same as 
the entries of the first column of A’. Compare 
cofactors (these are the + determinants of smaller 
matrices that are transposes of one another) and 
use the inductive hypothesis to conclude that they 
are equal as well. 


67. Writing Let A and P be n x n matrices, where P is 
invertible. Does P~'AP = A? Illustrate your conclusion 
with appropriate examples. What can you say about the 
two determinants |P~'AP| and |A|? 


68. Writing Let A be an nxn nonzero matrix 
satisfying A! = O. Explain why A must be singular. 
What properties of determinants are you using in your 
argument? 


69. Proof A square matrix is skew-symmetric when 
A’ = —A. Prove that if A is ann x n skew-symmetric 
matrix, then |A| = (— 1)"|A]. 
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70. Proof Let A be a skew-symmetric matrix of odd order. 
Use the result of Exercise 69 to prove that |A| = 0. 


True or False? In Exercises 71 and 72, determine 
whether each statement is true or false. If a statement is 
true, give a reason or cite an appropriate statement from 
the text. If a statement is false, provide an example that 
shows that the statement is not true in all cases or cite an 
appropriate statement from the text. 
71. (a) If A is an n x n matrix and c is a nonzero scalar, 
then the determinant of the matrix cA is nc + det(A). 
(b) If A is an invertible matrix, then the determinant of 
A`! is equal to the reciprocal of the determinant of A. 
(c) If A is an invertible n x n matrix, then Ax = b has 
a unique solution for every b. 
72. (a) The determinant of the sum of two matrices equals 
the sum of the determinants of the matrices. 
(b) If A and B are square matrices of order n, and 
det(A) = det(B), then det(AB) = det(A2). 
(c) If the determinant of an n x n matrix A is nonzero, 
then Ax = O has only the trivial solution. 


Orthogonal Matrices In Exercises 73-78, determine 
whether the matrix is orthogonal. An invertible square 
matrix A is orthogonal when A~! = A’. 


0 il il 0 
afe t a[i 9] 
i =i 1/ V2 =-1/⁄/2 
s[i AeA A 
0 1//2 0 -1//2 
77. |0 0 1 78. 0 1 0 


O 1 0 Vg 0 if 


79. Proof Prove that the nxn identity matrix is 
orthogonal. 


80. Proof Prove that if A is an orthogonal matrix, then 
|A] = +1. 


AY Orthogonal Matrices In Exercises 81 and 82, use a 


graphing utility to determine whether A is orthogonal. 
Then verify that |A| = +1. 


3 0 _4 2 _2 1 
5 S 3 3 3 
8. A4=|0 1 0 82.4 =|} + -% 
4 0 3 i 2 2 
S 5 3 3 3 


83. Proof If A is an idempotent matrix (A? = A), then 
prove that the determinant of A is either 0 or 1. 


84. Proof Let S be an n x n singular matrix. Prove that 
for any n x n matrix B, the matrix SB is also singular. 
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3.4 Applications of Determinants 


Find the adjoint of a matrix and use it to find the inverse of 
the matrix. 


Use Cramer's Rule to solve a system of n linear equations in 
n variables. 


J Use determinants to find area, volume, and the equations of 
lines and planes. 


THE ADJOINT OF A MATRIX 


So far in this chapter, you have studied procedures for evaluating, and properties of, 
determinants. In this section, you will study an explicit formula for the inverse of a 
nonsingular matrix and use this formula to prove a theorem known as Cramer’s Rule. 
You will also use Cramer’s Rule to solve systems of linear equations, and study several 
other applications of determinants. 

Recall from Section 3.1 that the cofactor C;; of a square matrix A is (—1)'*/ times 
the determinant of the matrix obtained by deleting the ith row and jth column of A. The 
matrix of cofactors of A has the form 


Ci Cio Cin 
Cai Ca Con 
Ca Cassa Cy 


The transpose of this matrix is the adjoint of A and is denoted adj(A). That is, 


Cy “Gavees Cri 
satay = Ci C2 bobs Cn 
Ce Groas Ca 
EXAMPLE 1 Finding the Adjoint of a Square Matrix 
=] 3 2 
Find the adjoint of A =| 0 -2 1}. 
1 0 =2 
SOLUTION 
The cofactor C,, is 
ci =7 1 
=2 1| => Caı=(-1F 0 EE 
0 =2 
Continuing this process produces the matrix of cofactors of A shown below. 
4 1 2 
6 0 3 
7 1 2 
4 6 7 
The transpose of this matrix is the adjoint of A. That is, adj(A) = | 1 0 1}. H 
2 3 2 
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The adjoint of a matrix A can be useful for finding the inverse of A, as shown in 
the next theorem. 


REMARK 


Theorem 3.10 is not particularly THEOREM 3.10 The Inverse of a Matrix Using Its Adjoint 
efficient for finding the inverse 


of a matrix. The Gauss-Jordan 
elimination method discussed 
in Section 2.3 is much more 
efficient. Theorem 3.10 is 
theoretically useful, however, PROOF 

because it provides a concise Begin by proving that the product of A and its adjoint is equal to the product of the 
formula for the inverse of determinant of A and /,. Consider the product 


If Ais ann x n invertible matrix, then A~! = adj(A). 


det(A) 


a matrix. 
Gii “Giese, lia 
au an2 Ay, || Cy, Ca Ci Cn 
Aladj(A)] = i Jj Ciz Ca Cp Cn2 
a, n Gin : : : 
: : ICO. Cor ies 
ant an2 Ann 


REMARK 


If A is a 2 x 2 matrix 


A= 2 el then the adjoint 
c d 


The entry in the ith row and jth column of this product is 


aC, + nC +.---+a C. 


in~jn* 


If i = j, then this sum is simply the cofactor expansion of A in its ith row, which means 


of A is simply : . Ei pek i 
that the sum is the determinant of A. On the other hand, if i # j, then the sum is zero. 
adj(A) = ie =A (Verify this.) 
det(A) O oas 0 

Moreover, if A is invertible, ; 0 det(A) 
then from Theorem 3.10 you A[adj(A)] = : : |7 det(A)I 
have 0 0... det(A) 

A= eda The matrix A is invertible, so det(A) # 0 and you can write 

1 d -b 1 PRS | er l z 
=, "J Aladj(A)] =I or A adj(A) | = Z. 
ad — bd —- | det(A) [adj(A)] det(A) it 


which agrees with the formula By Theorem 2.7 and the definition of the inverse of a matrix, it follows that 
given in Section 2.3. 


1 . = =] 
ag Aan n 
A] Using the Adjoint of a Matrix 
Z EE to Find Its Inverse 
=j 3 2 
Use the adjoint of A to find A~!, where A = 0 -2 1}. 
1 0 -2 


SOLUTION 


The determinant of this matrix is 3. Using the adjoint of A (found in Example 1), the 
inverse of A is 


4 7 

4 6 T 3 3 

Aal —_1 la 1 
A inan 3! 0 1| = 3 0 3 
2 3 2 2 2 

3 1 35 


Check that this matrix is the inverse of A by showing that AA™! = I = A™!A. m 
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Chapter 3 


Determinants 


CRAMER’S RULE 


Cramer’s Rule, named after Gabriel Cramer (1704—1752), uses determinants to solve 
a system of n linear equations in n variables. This rule applies only to systems with 
unique solutions. To see how Cramer’s Rule works, take another look at the solution 
described at the beginning of Section 3.1. There, it was pointed out that the system 


4X; + aX% = b; 
aX; + aX% = by 
has the solution 


b,da5, — b,a 
x, = 1422 snd x% = 
411492 T 21412 1472 ~ a21đã12 


body, — bia; 


when 4;1422 — 421412 # 0. A determinant can represent each numerator and denominator 
in this solution, as shown below. 


b) ay ay b, 

b, a» a21 b, 0 
45 >» Q= > aiil T az F 

ai ai ai ai 

a an a an 


The denominator for x, and x, is simply the determinant of the coefficient matrix A 
of the original system. The numerators for x, and x, are formed by using the column 
of constants as replacements for the coefficients of x, and x, in |A|. These two 
determinants are denoted by |A,| and |A,|, as shown below. 


el ee 
b, ay, b, 
_ Al l n, TR 
You have x, Al and x, Al This determinant form of the solution is called 


Cramer’s Rule. 


EXAMPLE 3 Using Cramer's Rule 


Use Cramer’s Rule to solve the system of linear equations. 


4x, = 2x, = 10 
3x, — 5x, = 11 
SOLUTION 
First find the determinant of the coefficient matrix. 
4 -2 
A| = = — 14 
TE 


The determinant is nonzero, so you know the system has a unique solution, and 
applying Cramer’s Rule produces 


10 -2 
_ {A,| H1 -5| _-28_ 
“Al m 14 
and 
$ | 
A) B n M a 
%2 ™ JA] 214 = i 
The solution is x, = 2 and x, = —1. m 
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Cramer’s Rule generalizes to systems of n linear equations in n variables. The value 
of each variable is the quotient of two determinants. The denominator is the determinant 
of the coefficient matrix, and the numerator is the determinant of the matrix formed by 
replacing the column corresponding to the variable being solved for with the column 
representing the constants. For example, x, in the system 


aX; + aX + Ay3X3 = b; |A,| 


aX; + aX + 43%, = b) is x = 
z)X1 + a333 + A33X; = b3 


THEOREM 3.11 Cramer's Rule 


If a system of n linear equations in n variables has a coefficient matrix A with a 
nonzero determinant |A , then the solution of the system is 


Pp det(A,) — det(A,) Pe det(A,,) 
1 det(A)’ ~*~ det(A)’ °° ” det(A) 


where the ith column of A; is the column of constants in the system of equations. 


PROOF 
Let the system be represented by AX = B. The determinant of A is nonzero, so you 
can write 
1 
X = AB = a4 =e) a ew n E 
1 
If the entries of B are b,, b),. . ., b,, then x, = ec + bCa + © + bCa 
but the sum (in parentheses) is precisely the cofactor expansion of A;, which means that 
x; = |A;|/|A|, and the proof is complete. | 


EXAMPLE 4 l Using Cramer's Rule 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


Use Cramer’s Rule to solve the system of linear equations for x. 


=x + 2y —-3z=1 
2x + z=0 
3x — 4y + 4z =2 
SOLUTION 
=] 2 =3 
The determinant of the coefficient matrix is |A| = | 2 0 1| = 10. 
3 —4 4 
REMARK The determinant is nonzero, so you know that the solution is unique. Apply Cramer’ s 
Rule to solve for x, as shown below. 
Apply Cramer’s Rule to solve 
for y and z. You will see that 1 2 -3 
the solution is y = -3 and 0 0 1 1 2 
z= (W15 
5 2 —4 4 2 —4 (1)(-1)(-8) 4 
s= i 10 aia | ae | 
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y 
A 
(x3, y3) 
(x2, y2) 
(x1, yı) i j 
i 1 [i P 
(x10)  @3,0)  @2 0) 
Figure 3.1 


AREA, VOLUME, AND EQUATIONS OF LINES AND PLANES 


Determinants have many applications in analytic geometry. One application is in 
finding the area of a triangle in the xy-plane. 


Area of a Triangle in the xy-Plane 


The area of a triangle with vertices 


Gi yı), Uz: Yo), and (x3, yz) 


X 


where the sign (+) is chosen to give a positive area. 


PROOF 
Prove the case for y; > 0. Assume that x, < x, < x, and that (x3, y4) lies above the 
line segment connecting (x,, y,) and (xz, y2), as shown in Figure 3.1. Consider the three 
trapezoids whose vertices are 

Trapezoid 1: (x,, 0), (x, y1), (3, y3), (x3, 0) 

Trapezoid 2: (x3, 0), (x3, Y3), (X2; Y2), (xə, 0) 

Trapezoid 3: (x,, 0), (x, y1), Œz Y2), (%>, 0). 


The area of the triangle is equal to the sum of the areas of the first two trapezoids minus 
the area of the third trapezoid. So, 


1 1 1 
Area = 3(y, + ys)(%3 — x1) + o(y3 + y) — x3) — 201 + ya) = x) 
1 
= 3(X1Y. + X3 F X3Yy T XyV3 T Ay T x32) 


X yı 1 
i 
57% = Yo 1. 
X3 »3 1 


If the vertices do not occur in the order x, S x, S x, or if the vertex (x3, y,) is not 
above the line segment connecting the other two vertices, then the formula above 
may yield the negative of the area. So, use + and choose the correct sign to give a 
positive area. 


EXAMPLE 5 Finding the Area of a Triangle 


Find the area of the triangle whose vertices are 


(1,1), (2,2), and (4,3). 


SOLUTION 


It is not necessary to know the relative positions of the three vertices. Simply evaluate 
the determinant 


1 1 1 
1 1 
5|2 2 l| = -3 
4 3 1 
and conclude that the area of the triangle is ; square unit. 
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Figure 3.2 
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If the three points in Example 5 had been on the same line, what would have 
happened when you applied the area formula? The answer is that the determinant would 
have been zero. Consider, for example, the three collinear points (0, 1), (2, 2), and 
(4, 3), as shown in Figure 3.2. The determinant that yields the area of the “triangle” that 
has these three points as vertices is 


© f i 
1 
H2 2 1=0. 
4 3 4 


If three points in the xy-plane lie on the same line, then the determinant in the formula 
for the area of a triangle is zero, as generalized below. 


Test for Collinear Points in the xy-Plane 


Three points (x,, y,), (xz, Y2), and (x3, yz) are collinear if and only if 


Vi Ji 1 
det} x, yy 1 
1 


X3 y3 


The test for collinear points can be adapted to another use. That is, when you are 
given two points in the xy-plane, you can find an equation of the line passing through 
the two points, as shown below. 


Two-Point Form of an Equation of a Line 


An equation of the line passing through the distinct points (x,, y,) and (x,, y,) is 


det} x, yı 


X2 V2 


J Æ Finding an Equation of the Line 
EXAMPLE 6 Passing Through Two Points 
Find an equation of the line passing through the points 
(2,4) and (—1, 3). 


SOLUTION 


Let (x,, yı) = (2, 4) and (x5, y2) = (— 1, 3). Applying the determinant formula for an 
equation of a line produces 


x y 1 
2 4 1| = 0. 
=1 3 1 


To evaluate this determinant, expand by cofactors in the first row. 


4 2 1 2 4 
~i ee hele s|=9 
x(1) — y(3) + 110) = 0 
x—3y+ 10=0 
So, an equation of the line is x — 3y = — 10. 
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The formula for the area of a triangle in the plane has a straightforward 
generalization to three-dimensional space, which is presented below without proof. 


Volume of a Tetrahedron 


The volume of a tetrahedron with vertices (x4, Y1, Z1), (X2, Y2 Z2), (X3; Y3; Z3), and 
Ga Y4 z4) is 


X yı Zi 


x z 
Volume = +ġdet a2 ? 
x3 B Z3 


X4 X4 Z4 


where the sign (+) is chosen to give a positive volume. 


EXAMPLE 7 Finding the Volume of a Tetrahedron 


Find the volume of the tetrahedron shown in Figure 3.3. 


SOLUTION 
Using the determinant formula for the volume of a tetrahedron produces 
0 4 1 1 
1/4 0 0 Yay nae 
elz 5 2 || = al 72) = -12. 
2 2 5 1 
So, the volume of the tetrahedron is 12 cubic units. P| 
Figure 3.3 If four points in three-dimensional space lie in the same plane, then the determinant 


in the formula for the volume of a tetrahedron is zero. So, you have the test shown below. 


Test for Coplanar Points in Space 


Four points (x), Yi Z1), (X2; Y2 Z2), (X3; Y3» Z3), and (x4, Y4, Z4) are coplanar if and 
only if 


4 å D» <1 
v D) Z2 
%3 å D) Z3 
X4 X4 Z4 


det 


An adaptation of this test is the determinant form of an equation of a plane passing 
through three points in space, as shown below. 


Three-Point Form of an Equation of a Plane 


An equation of the plane passing through the distinct points (x,, y,, Z1), X>; Y2 Z2), 
and (x3, Yz, Z3) is 


y 
yy 
J 
Y3 
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Finding an Equation of the Plane 
EXAMPLE 8 Passing Through Three Points 


Find an equation of the plane passing through the points (0, 1,0), (—1, 3, 2), and 


(—2, 0, 1). 
SOLUTION 
Using the determinant form of an equation of a plane produces 
x y Zz 1 
1 1 
e 3 i” 
=2 0 1 1 


To evaluate this determinant, subtract the fourth column from the second column to obtain 


ep Z 1 

0 0 0 1 
—] 2 2 1 = 
=o. =j 1 1 


Expand by cofactors in the second row. 


2 2 = 2 -1 2 
= = + = 
ae i (y o; i 49 || ° 
x(4) — (y — 1)(3) + 2(5) = 0 
This produces the equation 4x — 3y + 5z = —3. m 
LINEAR On November 12, 2014, European Space Agency's Rosetta 


orbiting spacecraft landed the probe Philae on the surface 
ALGEBRA of the comet 67P/Churyumov-Gerasimenko. Comets that 
APPLIED orbit the Sun, such as 67P, follow Kepler's First Law of 
Planetary Motion. This law states that the orbit is an ellipse, 
with the sun at one focus of the ellipse. The general 
equation of a conic section, such as an ellipse, is 


ax? + bxy + cy? + dx+ ey + f=0. 


To determine the equation of the comet's orbit, astronomers 
can find the coordinates of the comet at five different 
points (x, y), where i = 1, 2, 3, 4, and 5, substitute these 
coordinates into the equation 


x? xy yr x y 
xX XY yp xX Vs 
X XV VB XD Vp 
XE XY Y X Yz 
X4Y4 Ya X, Ya 
XE  X5Xs Ye Xs Ys 


ey ey es ey SE, ce 
ll 
© 


and then expand by cofactors in the first row to find a, b, c, 
d, e, and f. For example, the coefficient of x? is 


XY Vi M NY 
XY Y X V 
a= |X3⁄3 Y X% Vs 
XaYa Va Xa Ya 
XYs V X Ys 


ae ee ee | 


Knowing the equation of 67P’s orbit helped astronomers 
determine the ideal time to release the probe. 
Jet Propulsion Laboratory/NASA 
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- Ege 
3 4 Exercises See CalcChat.com for worked-out solutions to odd-numbered exercises. zf - 
z ee [m] E it: 


Chapter 3 Determinants 


Finding the Adjoint and Inverse of a Matrix In Ae Using Cramer’s Rule In Exercises 23-26, use a 
Exercises 1-8, find the adjoint of the matrix A. Then use 
the adjoint to find the inverse of A (if possible). 


S software program or a graphing utility and Cramer’s 


Rule to solve (if possible) the system of linear equations. 


fae | ‘| he E ‘| 23. gx, — x, = —20 
3 4 0 4 BA — IX = — 5] 
nO LO 2 3 24. —8x, + 7x, — 10x, = —151 
3. A =]0 2 6 4 A=]|0 1 =1 Bi tana Sx, 86 
aie a. = & 15x, — 9x) + 2x, = 187 
Ae = E 7 eye : i ; 25. 3x, — 2x, +9, +4%,= 35 
0 eai =) -1 -2 =x; — 9x, — 6x, = —17 
3x, + x4 = 5 
=1 2 0 1 2x, + 2x, + 8x,= —4 
7. A= h p i > 26. -x-2 X% +x,= =8 
Zj 1 1 2 3x, + 5x + 5x3 = 24 
2X4 +x, = —6 
1 1 1 0 = 2x) = 3X5 = 3X, =—-15 
1 1 0 1 
8. A= l 0 I l 27. Use Cramer’s Rule to solve the system of linear 
0 1 1 1 equations for x and y. 


kx + (1 — ky = 1 
(1 — k)x + ky = 3 


For what value(s) of k will the system be inconsistent? 


Using Cramer's Rule In Exercises 9-22, use Cramer’s 
Rule to solve (if possible) the system of linear equations. 


9% x, + 2x, =5 10. 2x — y=~—10 

-x,+ x =1 3x+2y= -1 28. Verify the system of linear equations in cos A, cos B, 
11. 3x + 4y = —2 12, 18x, + 12x, = 13 and cos C for the triangle shown. 

5x +3y= 4 30x, + 24x, = 23 ccosB + bcosC =a 
13. 20x + 8y= 11 14. 13x — 6y=17 c cos A + acosC = b 

12x — 24y = 21 26x — 12y= 8 bcosA + acosB =e 
15. —0.4x, + 0.8x,=1.6 16. —0.4x, + 0.8x, = 1.6 Thence Cramers Ruleta C 

2x, — 4x, =5.0 0.2x, + 0.3x, = 0.6 solve for cos C, and use the b i 

17. 4x- y- z= 1 18. 4x — 2y + 3z = —2 result to verify the Law of 

2x + 2y +3z= 10 2x + 2y +5z= 16 Cosines, 

Sx — 2y - z = -1 8x—Sy-2z= 4 e=a+b—-2abcosC. A c B 


19. 3x + 4y + 4z = 11 


4x — 4y + 6z = 11 Finding the Area of a Triangle In Exercises 29-32, 


find the area of the triangle with the given vertices. 


6x — 6y = 3 
20. 14x, — 21x, — 7x, = -21 29. (0, 0), (2, 0), (0, 3) 30. (1, 1), (2, 4), (4, 2) 
— 4x + 2X5 = 2X, = 2 31. (= l; 2); (2, 2), (=2, 4) 32. G, 1), (= 1; 1), (0, =2) 
36x1 — 2lx, + 7x3 = 7 Testing for Collinear Points In Exercises 33-36, 
21. 4x, — nt x3= —5 determine whether the points are collinear. 


2x, + 2x, + 3x, = 10 
5x, — 2x, + 6x, = 1 
22. 2x, + 3x, + 5x, = 4 
3x, + 5x, + 9x, = 7 
5x, + 9x, + 17x, = 13 


33. (1, 2), (3, 4), (5, 6) 

34. (— 1,0), (1, 1), (3, 3) 

35. (—2, 5), (0, — 1), (3, =9) 
36. (—1, —3), (—4, 7), (2, — 13) 
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Finding an Equation of a Line In Exercises 37-40, 
find an equation of the line passing through the points. 


37. (0, 0), (3, 4) 38. (—4, 7), (2, 4) 
39. (—2, 3), (—2, —4) 40. (1, 4), (3, 4) 
Finding the Volume of a Tetrahedron In Exercises 


41-46, find the volume of the tetrahedron with the given 
vertices. 


41. (1, 0, 0), (0, 1, 0), (0, 0, 1), (1, 1, 1) 

42. (1, 1, 1), (0, 0, 0), (2, 1, — 1), (~ 1, 1, 2) 

43. (3, — 1, 1), (4, —4, 4), (1, 1, 1), (0, 0, 1) 

44. (0, 0, 0), (0, 2, 0), (3, 0, 0), (1, 1, 4) 

45, (=3, =3, =3), (3, = 1, =3), (= 3, =1,=3), (=2,3,2) 
46. (5, 4, —3), (4, —6, — 4), (—6, —6, — 5), (0, 0, 10) 


Testing for Coplanar Points In Exercises 47-52, 
determine whether the points are coplanar. 


47. (—4, 1, 0), (0, 1, 2), (4, 3, — 1), (0, 0, 1) 

48. (1, 2,3), (= 1,0; 1), (0, —2, — 5), (2,6, 11) 

49. (0,0, — 1), (0, — 1, 0), (1, 1, 0), (2, 1, 2) 

50. (1, 2, 7), (—3, 6, 6), (4, 4, 2), (3, 3, 4) 

51. (—3,—2,— 1); (2, 1, —2),.(— 3, — 1, — 2), (3,2-1) 
52. (1, —5, 9), (—1, —5, 9), (1, —5, —9), (= 1, —5, —9) 


Finding an Equation of a Plane In Exercises 53-58, 
find an equation of the plane passing through the points. 


53. (1, —2, 1), (1, —1, 7), 2, —1, 3) 
54. (0, —1, 0), (1, 1, 0), (2, 1, 2) 

55. (0, 0, 0), (1, — 1, 0), (0, 1, — 1) 

56. (1, 2,7), (4, 4, 2), (3, 3, 4) 
57. (—4, —4, —4), (4, —1, 
58. (3, 2, —2), (3, 


4), (—4, —1, —4) 
2, 2), (—3, —2, =2) 


Using Cramer’s Rule In Exercises 59 and 60, determine 
whether Cramer’s Rule is used correctly to solve for the 
variable. If not, identify the mistake. 


1 2 1 
—1 =2 
x+2y+ z=2 4 : 24 
59. —x + 3y — 2z =4 y= 
4x+ y- z=6 l 2 l 
-1 4 -2 
4 6 =1 
15. 2 1 
=7 =3 =i 
5x—2y+ z= 15 3 = 4 
60. 3x — 3y- z= -7 x= 
x= y= z= =3 3 = l 
3 S30 =i 
2 =] =7 


3.4 Exercises 143 


61. Software Publishing The table shows the estimated 
revenues (in billions of dollars) of software publishers 
in the United States from 2011 through 2013. 
(Source: U.S. Census Bureau) 


Year | Revenues, y 
2011 156.8 
2012 161.7 
2013 177.2 


(a) Create a system of linear equations for the data to fit 
the curve 
y=a?+t+btt+c 
where t = 1 corresponds to 2011, and y is the 
revenue. 

(b) Use Cramer’s Rule to solve the system. 

Pe (c) Use a graphing utility to plot the data and graph 

the polynomial function in the same viewing 
window. 


(d) Briefly describe how well the polynomial function 
fits the data. 


62. CAPSTONE Consider the system of linear 
equations 
aix + biy = c 
ax + by = c, 
where aj, b,, Ci an bj, and c, represent real 
numbers. What must be true about the lines 
represented by the equations when 


ai b, 
b 


=0? 


63. Proof Prove that if |A| = 1 and all entries of A are 
integers, then all entries of |A~'| must also be integers. 


64. Proof Prove that if ann x n matrix A is not invertible, 
then A[adj(A)] is the zero matrix. 


Proof In Exercises 65 and 66, prove the formula for a 
nonsingular n x n matrix A. Assume n = 2. 


65. |adj(A)| = |A|"~! 66. adjladj(A)] = |A|"~2A 
67. Illustrate the formula in Exercise 65 using a nonsingular 
2 x 2 matrix A. 


68. Illustrate the formula in Exercise 66 using a nonsingular 
2 x 2 matrix A. 


69. Proof Prove that if A is an n x n invertible matrix, 
then adj(A~!) = [adj(A)]~!. 

70. Illustrate the formula in Exercise 69 using a nonsingular 
2 x 2 matrix A. 
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The Determinant of a Matrix In Exercises 1-18, find 
the determinant of the matrix. 


4 -1 0 =3 
tte 73] al | 
=3 1 =2 0 
ae S| 41> | 
=i 3 —4 a] 0 2 
5. 0 =2. =1 6 |0 =1 3 
= 1 0 0 1 
=2 0 0 =I15 0 4 
7. 0 =3 0 8. 3 0 =5 
0 0 =I 12 0 6 
=3 6 9 =15 0 3 
9. 9 12 =3 10. 3 9 =6 
0 15 =6 12 =3 6 
2 0 =1 4 2 0 0 0 
=1 2 0 3 =3 1 0 0 
Hh 3 0 1 2 Mai 4 -1 3 0 
=2 0 3 1 5 2 1 =1 
—4 1 2 3 3 =l 2 1 
i. a2 1 2 =2 0 I =3 
1a 2 =] 3 4 i =] 2 =3 4 
1 2 2 =i =2 1 =2 1 


O =- rR N. 
FP O NUN 
=- N OF Ke 
— 
l 
ee 


17. 


oocoooer 

ococoro 
| 

oomoo 


18. 


EE A 2k.  . ab |  — A tC — l Af . Qc -vr 4 

| 

ooreor 

| 

= = O =e Fe 
l 

= O =. Fe 

l l 

eRe Fe CO o 

| 

= =. Or © 


vooo oO 
oWOC CO 
cocoowNCc So 
CoCo OW Oo 
ooo OW 


Properties of Determinants In Exercises 19-22, 
determine which property of determinants the equation 
illustrates. 


4 -1 
19. lg -4 =O 
1 2 =l I = 2 
20.2 o 3/=-|2 3 o0 
=i i 4 1 =l 
=f | 2 2 1 1 2 
0 4 6 1 @ = 2 1 
Als s g flo i =z 3 d 
6 12 -6 1 6 =3 =3 4 
1 3 ah 3 1 
2,10 -1 2%2=(2 5 4 
1 1 lf 2 1 


The Determinant of a Matrix Product In Exercises 23 
and 24, find (a) |A|, (b) |B|, (c) AB, and (d) |AB|. Then 
verify that |A||B| = |AB|. 


=I 2 3 4 
nafi AE 4] 


0 1 2 2 1 2 
24. A=]5 4 3|, B=|1 -1 0 
7 6 8 0 =2 


Finding Determinants In Exercises 25 and 26, find 
(a) |AT], (b) |A3|, (c) [ATA], and (d) |5A]. 


3 0 1 
5. 4=|~3 i 26. A=|-1 0 0 
> 1 2 


Finding Determinants In Exercises 27 and 28, find 
(a) |A| and (b) |A7]. 


1 0 -4 =2 1 3 
27. A=| 0 3 2| 28. A= 2 0 4 
=2 7 6 = 5 0 


The Determinant of the Inverse of a Matrix In 
Exercises 29-32, find |A~!|. Begin by finding A™, 
and then evaluate its determinant. Verify your result 
by finding |A| and then applying the formula from 


1 
-1| = — 
Theorem 3.8, |A-!]| ay" 
=2 4 10 2 
29.4 =| ji i 3. A=] 5 ‘| 
1 0 1 =] 1 2 
31. A=|2 -1 4 32. A = 2 8 
2 6 0 1 =] 0 
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Solving a System of Linear Equations In Exercises 
33-36, solve the system of linear equations by each of the 
methods listed below. 


(a) Gaussian elimination with back-substitution 


(b) Gauss-Jordan elimination 


(c) Cramer’s Rule 


33. 


34. 


35. 


36. 


3x, + 3x, + 5x, = 1 
3x, + 5x, + 9x, = 2 
5x, + 9x, + 17x, = 4 

X, + 2x, + x,=4 
—3x, + x — 2x, = 1 

2x, + 3x, = 

x, 2% xy 7 
2%, = 2%, = 2x, = —8 
=x; + 3x, +4x,= 8 
2x, + 3x, + 5x, = 4 
3x, + 5x, + 93 = 7 
5x, + 9x, + 13x, = 17 


x, =9 


System of Linear Equations In Exercises 37—42, use 
the determinant of the coefficient matrix to determine 
whether the system of linear equations has a unique 


solution. 

37. 6x + 5y= 0 38. 2x — 5y = 2 
x- y=22 3x — Ty =1 

39. -x+ y+2z= 1 40. 2x+ 3y+ z= 10 
2x+3y+ z=-2 2x = 3y = 32 = 22 
5x +4y+2z= 4 8x + 6y ==2 


41. 


42. 


43. 


44. 


45. 


Xx t2% + 6x = 1 
2x, + 5x, + 15x = 4 
3x, + x, + 3x, = —6 


Xx, + 5x, + 3x5 = 14 
4x, + 2x, + 5x, = 3 
3x, + 8x, + 6x; = 16 
2x, + 4x, —2x5= 0 
2x, = = 0 
Let A and B be square matrices of order 4 such that 
A| = 4 and |B| = 2. Find (a) |BA|, (b) |B?|, (c) |2A], 
(d) |(AB)"|, and (e) |B]. 
Let A and B be square matrices of order 3 such that 
A| = —2and |B| = 5. Find (a) |BA|, (b) |B4|, (c) [2A], 
(d) |(AB)"|, and (e) |B]. 
Proof Prove the property below. 
a1 a2 413 au an 43 
a2 a22 473) = |2 în l3 
a31 F C31 G37 + C32 33 F C33 43; 32 33 


46. 


47. 


48. 


Review Exercises 145 


Illustrate the property in Exercise 45 with A, C31, C32, 
and c33 below. 


1 0 2 
A= 11 =1 2|, Ca = 3, Cy =0, cy, = 1 
2 1 =] 
Find the determinant of the n x n matrix. 
l-n 1 | S 1 
1 l-n | a 1 
1 1 1 l-n 
Show that 
a 1 1 1 
Fe l =at- 
1 1 1 a 


Calculus In Exercises 49-54, find the Jacobians of the 
functions. If x, y, and z are continuous functions of u, v, 
and w with continuous first partial derivatives, then the 
Jacobians J(u, v) and J(u, v, w) are 


ax ax ax 
Ox = Ox Ou Ov Ow 

J(u, v) = ve and J(u, v, w) = oe r ir ; 
ðu Ov Oz Oz Az 

Ou Ov Ow 

49. x = 5(v — u), y= iv +u) 

50. x = au + bv, y= cu + dv 

51. x = ucosv, y=usinv 

52. x = e" sin v, y = e” cos v 

53. x = į(u + v), y= 4u — v), z= 2uvw 

54.x=u-vtw, y=2w, z=u+vt+w 

55. Writing Compare the various methods for calculating 


56. 


57. 


58. 


the determinant of a matrix. Which method requires the 
least amount of computation? Which method do you 
prefer when the matrix has very few zeros? 


Writing Use the table on page 122 to compare the 
numbers of operations involved in calculating the 
determinant of a 10 x 10 matrix by cofactor expansion 
and then by row reduction. Which method would you 
prefer to use for calculating determinants? 


Writing Solve the equation for x, if possible. 


cos x 0 sin x 
sin x 0 cos x| = 0 
sin x — cos x 1 sin x + cos x 


Proof Prove that if |A| = |B| + 0, and A and B are of 
the same size, then there exists a matrix C such that 


|C| =1 and A= CB. 
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Finding the Adjoint of a Matrix In Exercises 59 and 
60, find the adjoint of the matrix. 


1-1 1 
so. | S i 60. |0 
0 o0 -1 


System of Linear Equations In Exercises 61-64, use 
the determinant of the coefficient matrix to determine 
whether the system of linear equations has a unique 
solution. If it does, use Cramer’s Rule to find the solution. 
61. 0.2x — 0.ly= 0.07 62. 2x+ y= 03 
0.4x — 0.5y = —0.01 34 Sy aH =H 13 
63. 2x, + 3x, + 3x, = 3 
6x, + 6x, + 12x, = 13 
12% F 9x5, = 
64. 4x, + 4x, + 4x, = 5 
4x, — 2x, — 8x3; = 1 
8x, + 2x, — 4x, = 6 


x= 2 


acd Using Cramer’s Rule In Exercises 65 and 66, use a 


software program or a graphing utility and Cramer’s 
Rule to solve (if possible) the system of linear equations. 
65. 0.2x, — 0.6x, = 2.4 

—x, + 14x, = —8.8 
66. 4x, — x, + x, =—5 

2x, + 2x, + 3x, = 10 

5x, — 2x, + 6x,= 1 
Finding the Area of a Triangle In Exercises 67 and 68, 
use a determinant to find the area of the triangle with 
the given vertices. 


67. (1, 0), (5, 0), (5, 8) 68. (—4, 0), (4, 0), (0, 6) 


Finding an Equation of aLine In Exercises 69 and 70, 
use a determinant to find an equation of the line passing 
through the points. 


69. (—4, 0), (4, 4) 70. (2,5), (6, —1) 


Finding an Equation of a Plane In Exercises 71 and 
72, use a determinant to find an equation of the plane 
passing through the points. 

71. (0, 0, 0), (1, 0, 3), (0, 3, 4) 

72. (0, 0, 0), (2, — 1, 1), (~ 3, 2, 5) 

73. Using Cramer’s Rule Determine whether Cramer’ s 


Rule is used correctly to solve for the variable. If not, 
identify the mistake. 


-1 -4 -1 
= 1 

x-4y- z=-l j ; 
1 1 —4 

2x-3y+ z= 6 g= 

Mar | 1 -4 =] 
e Z3. j 
1 1 =4 


74. Health Care Expenditures The table shows annual 
personal health care expenditures (in billions of dollars) 
in the United States from 2011 through 2013. (Source: 
Bureau of Economic Analysis) 


2011 2012 2013 
1765 1855 1920 


Year 


Amount, y 


(a) Create a system of linear equations for the data to fit 
the curve 


y=af+bt+c 


where ¢ = 1 corresponds to 2011, and y is the 
amount of the expenditure. 


(b) Use Cramer’s Rule to solve the system. 


f (c) Use a graphing utility to plot the data and graph the 
polynomial function in the same viewing window. 


(d) Briefly describe how well the polynomial function 
fits the data. 


True or False? In Exercises 75-78, determine whether 
each statement is true or false. If a statement is true, give 
a reason or cite an appropriate statement from the text. 
If a statement is false, provide an example that shows the 
statement is not true in all cases or cite an appropriate 
statement from the text. 


75. (a) The cofactor C,, of a matrix is always a positive 
number. 


(b) If a square matrix B is obtained from A by 
interchanging two rows, then det(B) = det(A). 


(c) If one column of a square matrix is a multiple of 
another column, then the determinant is 0. 


(d) If A is a square matrix of order n, then 
det(A) = — det(A”). 
76. (a) If A and B are square matrices of order n such that 
det(AB) = —1, then both A and B are nonsingular. 


(b) If A is a 3x3 matrix with det(A) = 5, then 
det(2A) = 10. 
(c) If A and B are square matrices of order n, then 
det(A + B) = det(A) + det(B). 
77. (a) In Cramer’s Rule, the value of x; is the quotient 
of two determinants, where the numerator is the 
determinant of the coefficient matrix. 


(b) Three points (x, yi), (x,y), and (x3, y3) are 
collinear when the determinant of the matrix that has 
the coordinates as entries in the first two columns 
and 1’s as entries in the third column is nonzero. 


78. (a) The matrix of cofactors of a square matrix A is the 
adjoint of A. 


(b) In Cramer’s Rule, the denominator is the determinant 
of the matrix formed by replacing the column 
corresponding to the variable being solved for with 
the column representing the constants. 
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1 Stochastic Matrices 


In Section 2.5, you studied a consumer preference model for competing satellite 
television companies. The matrix of transition probabilities was 


Ob) ONS Ibs) 
BR 02055 0:80> 5 OF15)|: 
0.10 0.05 0.70 


When you were given the initial state matrix Xp, you observed that the portions of 
the total population in the three states (subscribing to Company A, subscribing to 
Company B, and not subscribing) after 1 year was X, = PX. 


0.1500 
X = | 0.2000 
0.6500 

0.70 0.15 0.15][0.1500] [0.2325 

X, = PX, =[|0.20 0.80 0.15 || 0.2000 | = | 0.2875 


0.10 0.05 0.70 || 0.6500 0.4800 
After 15 years, the state matrix had nearly reached a steady state. 


0.3333 
X,; = PX, ~ | 0.4756 
0.1911 


That is, for large values of n, the product P”X approached a limit X, PX = X. 


PX = X = 1X, so 1 is an eigenvalue of P with corresponding eigenvector X. 
You will study eigenvalues and eigenvectors in more detail in Chapter 7. 


A> 1. Use a software program or a graphing utility to verify the eigenvalues and 
eigenvectors of P listed below. That is, show that Px; = À;x; for i = 1, 2, and 3. 


Eigenvalues: à; = 1, A, = 0.65, à, = 0.55 


7 0 F2 
Eigenvectors: x, = | 101x% =|= M] x, = 1 
4 1 1 


2. Let S be the matrix whose columns are the eigenvectors of P. Show that S~'PS is 
a diagonal matrix D. What are the entries along the diagonal of D? 


3. Show that P” = (SDS~'!)” = SD"S~. Use this result to calculate X,, and verify 
the result above. 


2 The Cayley-Hamilton Theorem 


The characteristic polynomial of a square matrix A is the determinant |A/ — A|. 
If the order of A is n, then the characteristic polynomial p(A) is an nth-degree 
polynomial in the variable À. 


DA) detA — A) = Pc NS eb eA el + cy 


The Cayley-Hamilton Theorem asserts that every square matrix satisfies its 
characteristic polynomial. That is, for the n x n matrix A, p(A) = O, or 


A" +c, A" 1+++++ 6A? + c,A + col = O. 


Kurhan/Shutterstock.com 


Copyright 2017 Cengage Learning. All Rights Reserved. May not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eBook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage Learning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


148 Chapter 3 Determinants 


Note that this is a matrix equation. The n x n zero matrix is on the right, and the 
coefficient cy is multiplied by the n x n identity matrix /. 


1. Verify the Cayley-Hamilton Theorem for the matrix 


[2 =i} 


2. Verify the Cayley-Hamilton Theorem for the matrix 


6 0 4 
=? 1 ai 
2 0 4 


3. Verify the Cayley-Hamilton Theorem for a general 2 x 2 matrix A, 
a b 
A= : 
| c i 
4. For a nonsingular n x n matrix A, show that 


AmI = dear — c 


[EB S00 o = EA = Chh 
Co 


not 


Use this result to find the inverse of the matrix 


1 2 
A= : 
Ee 
5. The Cayley-Hamilton Theorem is useful for calculating powers A” of the square 
matrix A. For example, the characteristic polynomial of the matrix 


35 tel 
R 
is pA) =% -— 2) - 1. 
Using the Cayley-Hamilton Theorem, 


A?—-2A-1=O o A*=2A41. 


So, A? is written in terms of A and Z. 


3 Sl TERRO TEE? 
J= = = 
waraeraA? ilei S-i i] 


Similarly, multiplying both sides of the equation A? = 2A + I by A gives A? 
in terms of A’, A, and J. Moreover, you can write A? in terms of A and J by 
replacing A? with 2A + I, as shown below. 


AB =2A2+A=22A+ ND +A=5A42I 
(a) Write A* in terms of A and Z. 
(b) Find A? for the matrix 


0 0 1 
A=|2 Alb 
1 0 2 


(Hint: Find the characteristic polynomial of A, then use the Cayley-Hamilton 
Theorem to write A? in terms of A’, A, and 7. Inductively write A> in terms of 
A’, A, and Z.) 
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See CalcChat.com for worked-out solutions 


1 -3 Cu mu lative Test to odd-numbered exercises. 


Take this test to review the material in Chapters 1-3. After you are finished, check 
your work against the answers in the back of the book. 


In Exercises 1 and 2, determine whether the equation is linear in the variables x 


and y. 
4 3 7 
1--x=1 2. =x +—y=2 
_ oo 5°" 10° 
In Exercises 3 and 4, use Gaussian elimination to solve the system of linear 
equations. 
3. x-—2y=5 4. 4x, + x, -3x%,= Il 
3x + y=! 2X, — 3x, + 2x,= 9 


x, + x, + x, = -3 
Ae 5. Use a software program or a graphing utility to solve the system of linear equations. 
0.2x — 2.3y + 1.4z — 0.55w = — 110.6 
3.4x + 1.3y — 1.7z + 0.45w = 65.4 


0.5x — 4.9y + 1.lz— 1.6w = — 166.2 
0.6x + 2.8y — 3.4z + 0.3w 189.6 


6. Find the solution set of the system of linear equations represented by the 
augmented matrix. 


0 I =] 0 2 
1 0 2 =l 0 
1 2 0 =] 4 


7. Solve the homogeneous linear system corresponding to the coefficient matrix. 


1 2 1 -2 
0 0 2 -4 
-2 -4 1 -2 


8. Determine the value(s) of k such that the system is consistent. 


x+2y-—z=3 
=% = prez=2 
-x+ y+z=k 


9. Solve for x and y in the matrix equation 2A — B = I, given 
=] 1 x 2 
A= B= ; 
[a al m iy 3 


1 
i | Show that this product is symmetric. 


} T . _ 
10. Find A*A for the matrix A | > 4 6 


In Exercises 11-14, find the inverse of the matrix (if it exists). 


-1 0 0 1 1 0 
11. | j A 12. | : s] 13.) 0 4 O| 14.|-3 6 5 
0 0 3 0 1 0 
In Exercises 15 and 16, use an inverse matrix to solve the system of linear equations. 
15. x+2y=0 16. 2x- y= 6 
3x — 6y = 8 2x +y= 10 
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17. 


18. 


19. 


20. 


21. 


22. 


23. 


24. 


25. 


Figure for 27 


29, 


26. 


27. 


28. 


Find a sequence of elementary matrices whose product is the nonsingular matrix 
below. 


[i ool 


Find the determinant of the matrix 
4 0 3 2 
0 1 =3. =5 
0 1 5 ly 
1 1 0 =3 
Find (a) |A|, (b) |B], (c) AB, and (d) |AB|. Then verify that |A| |B| = |AB]. 


Find (a) |A| and (b) |A7!]. 
5 A9 3 
A=|-1 0 4 
6 -8 2 


If |A| = 7 and A is of order 4, then find each determinant. 
(a) [3A] wM (©) JA! o A 


Use the adjoint of 
l =5> =i 
A= ]0 -2 1 
1 0 2 
to find A7!. 
Let x,, X2, X3, and b be the column matrices below. 
1 1 0 1 
x, = | 0 xX, = ]1 x, =|1 b=]|2 
1 0 1 3 


Find constants a, b, and c such that ax, + bx, + cx, = b. 

Use a system of linear equations to find the parabola y = ax? + bx + c that 
passes through the points (— 1, 2), (0, 1), and (2, 6). 

Use a determinant to find an equation of the line passing through the points (1, 4) 
and (5, — 2). 

Use a determinant to find the area of the triangle with vertices (—2, 2), (8, 2), 
and (6, — 5). 

Determine the currents /,, /,, and J, for the electrical network shown in the figure 
at the left. 


A manufacturer produces three different models of a product and ships them to 
two warehouses. In the matrix 

200 300 
A= |600 350 

250 400 


a; represents the number of units of model i that the manufacturer ships to 
warehouse j. The matrix 


B=[12.50 9.00 21.50] 


represents the prices of the three models in dollars per unit. Find the product BA 
and state what each entry of the matrix represents. 


Let A, B, and C be three nonzero n x n matrices such that AC = BC. Does it 
follow that A = B? If so, provide a proof. If not, provide a counterexample. 
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4 Vector Spaces 


4.1 Vectors in R” 

4.2 Vector Spaces 

4.3 Subspaces of Vector Spaces 
4.4 Spanning Sets and Linear Independence 

4.5 Basis and Dimension 

4.6 Rank of a Matrix and Systems of Linear Equations 
4.7 Coordinates and Change of Basis —— 
4.8 Applications of Vector Spaces 


Crystallography (p. 213) 


Image Morphing (p. 180) 


HANAHAN 


Digital Sampling (p. 172) 


Force (p. 157) 


Clockwise from top left, IM_photo/Shutterstock.com; LVV/Shutterstock.com; 1 51 
Richard Laschon/Shutterstock.com; Anne Kitzman/Shutterstock.com; Image Source/Getty Images 


Copyright 2017 Cengage Learning. All Rights Reserved. May not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eBook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage Lea the right to remove additional content at any time if subsequent rights restrictions require it. 


152 Chapter 4 Vector Spaces 


4.1 Vectors in R” 


Represent a vector as a directed line segment. 


Perform basic vector operations in R? and represent them 
graphically. 


Perform basic vector operations in R”. 
J Write a vector as a linear combination of other vectors. 


VECTORS IN THE PLANE 


In physics and engineering, a vector is characterized by two quantities (length and 
direction) and is represented by a directed line segment. In this chapter you will see 
that the geometric representation can help you understand the more general definition 
of a vector. 

Geometrically, a vector in the plane is represented by a directed line segment 
with its initial point at the origin and its terminal point at (x,, x,), as shown below. 


REMARK 


The term vector derives 
from the Latin word vectus, (X15 %2) e 
meaning “to carry.” The idea Terminal 
is that if you were to carry pom 
something from the origin to x 

the point (x,, X2), then the trip 
could be represented by the 
directed line segment from 
(0, 0) to (x,, X2). Vectors are 
represented by lowercase Initial point 
letters set in boldface type 
(such as u, v, w, and x). 


St 


> Xx 


The same ordered pair used to represent its terminal point also represents the vector. 
That is, x = (x,, x). The coordinates x, and x, are the components of the vector x. 
Two vectors in the plane u = (u, u) and v = (v;, v>) are equal if and only if 


u =v; and u = v. 


EXAMPLE 1 Vectors in the Plane 


a. To represent u = (2, 3), draw a directed line segment from the origin to the point 
(2, 3), as shown in Figure 4.1(a). 


b. To represent v = (— 1, 2), draw a directed line segment from the origin to the point 
(—1, 2), as shown in Figure 4.1(b). 


b. y 


>x 


Figure 4.1 m 
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A 
(uy + Vy, W2 + V9) 
aoe? 
(uj, U2) = -- n 
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di A 
u+v Pus 
M Ha 
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1 1 
py |! 
@--- 
bee 
v Aion x 
vi uy 
Vector Addition 
Figure 4.2 
y 
A 
e 
yf 
LH c>0 
> X 
y 
A 
v 
c<0 
> X 
J N 
e 
Figure 4.4 
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VECTOR OPERATIONS 


One basic vector operation is vector addition. To add two vectors in the plane, add 
their corresponding components. That is, the sum of u and v is the vector 
u + v = (uy, u) + (vi, v2) = (uy + vi, Uy + v). 


Geometrically, the sum of two vectors in the plane can be represented by the diagonal 
of a parallelogram having u and v as its adjacent sides, as shown in Figure 4.2. 

In the next example, one of the vectors you will add is the vector (0, 0), the zero 
vector. The zero vector is denoted by 0. 


EXAMPLE 2 Adding Two Vectors in the Plane 


Find each vector sum u + v. 

a. u = (1,4), v = (2, -2) 

b. u = (3, —2), v = (-3, 2) 

c. u = (2, 1), v = (0, 0) 

SOLUTION 

a. u + v = (1,4) + (2, —2) = (3, 2) 

b. u + v = (3, —2) + (—3, 2) = (0,0) = 0 
c. u + v = (2,1) + (0,0) = (2, 1) 


Figure 4.3 shows a graphical representation of each sum. 


a. y C A 
at LD gh 
3 Eo 3+ 
24u 9 (3. 2) m 
P T b 
1 ee e( 4 
me Taa pee ea 
-3-2-1 13 4 -3-2 -1 Ne 34 
= -2L v=(0, 0) 
E> (2, -2) 34 
—4 a4 
Figure 4.3 a 


Another basic vector operation is scalar multiplication. To multiply a vector v by 
a scalar c, multiply each of the components of v by c. That is, 


cv = cv, v2) = (cy, €v5). 


Recall from Chapter 2 that the word scalar is used to mean a real number. Historically, 
this usage arose from the fact that multiplying a vector by a real number changes the 
“scale” of the vector. For instance, when a vector v is multiplied by 2, the resulting 
vector 2v is a vector having the same direction as v and twice the length. In general, 
for a scalar c, the vector cv will be Jel times as long as v. If c is positive, then cv and 
v have the same direction, and if c is negative, then cv and v have opposite directions. 
Figure 4.4 shows this. 
The product of a vector v and the scalar — 1 is denoted by 


—v = (-1)v. 
The vector — v is the negative of v. The difference of u and v is 
u-v=u+ (-v). 


The vector v is subtracted from u by adding the negative of v. 


Copyright 2017 Cengage Learning. All Rights Reserved. May not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eBook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage Learning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


154 Chapter 4 Vector Spaces 


EXAMPLE 3 Operations with Vectors in the Plane 


Let v = (—2, 5) and u = (3, 4). Perform each vector operation. 

a. $v b. u-v c v+u 

SOLUTION 

a. v= (—2,5), so 3v = (2(—2), 2(5)) = (=1,3). 

b. By the definition of vector subtraction, u — v = (3 — (—2),4 — 5) = (5, — 1). 


c. Using the result of part (a), 5v + u = (- 1, 3) + (3,4) = (2, B), 


Figure 4.5 Figure 4.5 shows a graphical representation of these vector operations. a 


Vector addition and scalar multiplication share many properties with matrix 
addition and scalar multiplication. The ten properties listed in the next theorem play 
a fundamental role in linear algebra. In fact, in the next section you will see that it is 
precisely these ten properties that help define a vector space. 


THEOREM 4.1 Properties of Vector Addition and 
Scalar Multiplication in the Plane 


Let u, v, and w be vectors in the plane, and let c and d be scalars. 


1. u + vis a vector in the plane. Closure under addition 
~-utv=vtu Commutative property of addition 
.(u+v)+w=ut(v+w) Associative property of addition 
.u+0=u Additive identity property 
.u+(-u)=0 Additive inverse property 


. clu + v) = cu + cv Distributive property 
. (c + dju = cu + du Distributive property 


2 

3 

4 

5 

6. cu is a vector in the plane. Closure under scalar multiplication 

7 

8 

9. c(du) = (cd)u Associative property of multiplication 


10. 1(u) =u Multiplicative identity property 


REMARK PROOF 
Note that the associative The proof of each property is straightforward. For example, to prove the associative 
property of vector addition property of vector addition, write 
allows you to write such 
expressions as u +v + w (u + v) + w = [(u, u) + (vi, va)] + (wi, w2) 
without ambiguity, because = (u; + vi, u + vo) + (Wy, Wo) 
you obtain the same vector = ((u, + v,) + wy, (u + v) + w2) 


sum regardless of which 


addition is performed first. = (u + (v; + wy), u + (v, + Wy) 


= (uy, u) + (v; + Wy, vo + w») 


=u+ (v+ w). 
Similarly, to prove the right distributive property of scalar multiplication over addition, 
write 
(c + du = (c + d)(u,, u) 


(c + d)u,, (c + d)u,) 
cu, + du,, cu, + dus) 
CU, CU) + (du,, du) 
cu + du. 


epee Geeks hee pe 


The proofs of the other eight properties are left as an exercise. (See Exercise 63.) m 
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(d,=1,6) ¢ 

& 67 

(2, =1, 5) \U+V 
@ \ 


(4, —1, 3); 


Figure 4.6 


TECHNOLOGY 


Many graphing utilities and 
software programs can 
perform vector addition and 
scalar multiplication. If you 
use a graphing utility, then 
you may verify Example 4(b) 
as shown below. The 
Technology Guide at 
CengageBrain.com can help 
you use technology to perform 
vector operations. 


VECTOR:U 
e1=-1 
e2=0 
e3=1 


2U 
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VECTORS IN R” 


The discussion of vectors in the plane can be extended to a discussion of vectors in 
n-space. An ordered n-tuple represents a vector in n-space. For instance, an ordered 
triple has the form (x,, x2, X3), an ordered quadruple has the form (x,, x2, X3, x4), and 
a general ordered n-tuple has the form (x, X2, X3,- . .,%,). The set of all n-tuples is 
n-space and is denoted by R”. 


R! = 1-space = set of all real numbers 
R? = 2-space = set of all ordered pairs of real numbers 


R? = 3-space = set of all ordered triples of real numbers 


R” = n-space = set of all ordered n-tuples of real numbers 
An n-tuple (x,, X2, X3,- . - , X„) can be viewed as a point in R” with the x;’s as its 
coordinates, or as a vector x = (x,,X5,x3,. . .,%,) with the x;’s as its components. As 


with vectors in the plane (or R?), two vectors in R” are equal if and only if corresponding 
components are equal. [In the case of n = 2 or n = 3, the familiar (x, y) or (x, y, z) 
notation is used occasionally.] 

The sum of two vectors in R” and the scalar multiple of a vector in R” are the 
standard operations in R” and are defined below. 


Definitions of Vector Addition and Scalar Multiplication in R" 


Let u = (u4, uy, U3, . . .,u,) and V = (14, Va, V3,. . ., v,) be vectors in R” and 
let c be a real number. The sum of u and v is the vector 


u +v = (u; + vj, Uy + Vz, Uz, + V3... ., Up, + V,) 


and the scalar multiple of u by c is the vector 


cu = (Cl, Cuz, Clg das , CU). 


As with 2-space, the negative of a vector in R” is 


u = (— uj, “Uz, —U3,. . ., —U,) 


and the difference of two vectors in R” is 


u — v = = Vi U tay Vas . ., Up Z Vp). 


The zero vector in R” is denoted by 0 = (0, 0, 0,. . ., 0). 


EXAMPLE 4 : Vector Operations in R? 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


Let u = (—1, 0, 1) and v = (2, — 1, 5) in R?. Perform each vector operation. 


a utv b. 2u c. v— 2u 
SOLUTION 


a. To add two vectors, add their corresponding components. 
u + v = (—1,0, 1) + (2, —1,5) = (1,—1,6) 
b. To multiply a vector by a scalar, multiply each component by the scalar. 
2u = 2(—1, 0, 1) = (—2, 0, 2) 
c. Using the result of part (b), v — 2u = (2, — 1, 5) — (—2, 0, 2) = (4, — 1, 3). 


Figure 4.6 shows a graphical representation of these vector operations in R°. m 
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The properties of vector addition and scalar multiplication for vectors in R” listed 
below are similar to those listed in Theorem 4.1 for vectors in R?. Their proofs, based 
on the definitions of vector addition and scalar multiplication in R”, are left as an 
exercise. (See Exercise 64.) 


THEOREM 4.2 Properties of Vector Addition and 
Scalar Multiplication in R” 


Let u, v, and w be vectors in R”, and let c and d be scalars. 


oe 


u + visa vector in R”. Closure under addition 
utv=vtru Commutative property of addition 
(u+v)+w=u+(v+w) Associative property of addition 
u+0=u Additive identity property 
u+(-u) =0 Additive inverse property 

cu is a vector in R”. Closure under scalar multiplication 
clu + v) = cu + cv Distributive property 

(c + du = cu + du Distributive property 

c(du) = (cd)u Associative property of multiplication 


William Rowan Hamilton 
(1805-1865) 

Hamilton is considered to 
be Ireland's most famous 
mathematician. In 1828, he 
published an impressive 
work on optics entitled A 
Theory of Systems of Rays. 
In it, Hamilton included 
some of his own methods 


for working with systems 

of linear equations. He also EXAMPLE 5 Vector Operations in R* 

introduced the notion of 

MENG raRteHsHe equation Let u = (2, —1, 5,0), v = (4,3, 1, — 1), and w = (—6, 2, 0, 3) be vectors in R#. Find 


of a matrix (see Section a tas eich eduation 
7.1). Hamilton’s work led 8 q i 
to the development of a. x = 2u — (v + 3w) 
modern vector notation. Ar 

We still use his i, j, and k C = 2a vt x 


notation for the ofan SOLUTION 
tandard unit Trae ; ere : 

ene ie inte a. Using the properties listed in Theorem 4.2, you have 

(see Section 5.1). HIE 


2. 
3. 
4. 
5. 
6. 
T. 
8. 
9, 


j 
> 


l(u) =u Multiplicative identity property 


Using the ten properties from Theorem 4.2, you can perform algebraic 
manipulations with vectors in R” in much the same way as you do with real numbers, 
as demonstrated in the next example. 


x = 2u — (v + 3w) 
= 2u — v — 3w 
= 2(2, — 1, 5, 0) — (4,3, 1, —1) — 3(—6, 2, 0, 3) 
= (4, —2, 10, 0) — (4,3, 1, —1) — (— 18, 6, 0, 9) 
= (4-4 + 18,-2-3-6,10-—1-0,0+1-9) 
= (18, — 11, 9, — 8). 


b. Begin by solving for x. 
3(x + w) = 2u-v+x 
3x + 3w = 2u-v+x 
3x — x = 2u — v — 3w 
2x = 2u — v — 3w 
x = 3(2u — v — 3w) 
Using the result of part (a), 
x = 3(18, — 11,9, — 8) 


aa 24): La 


The Granger Collection, NYC 
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REMARK 


Note that in Properties 3 and 
5, two different zeros are used, 
the scalar 0 and the vector 0. 


4.1 Vectors in R” 157 


The zero vector 0 in R” is the additive identity in R”. Similarly, the vector — v is 
the additive inverse of v. The next theorem summarizes several important properties 
of the additive identity and additive inverse in R”. 


THEOREM 4.3 Properties of Additive Identity 
and Additive Inverse 


Let v be a vector in R”, and let c be a scalar. Then the properties below are true. 


. The additive identity is unique. That is, if v + u = v, thenu = 0. 


. The additive inverse of v is unique. That is, if v + u = 0, thenu = —v. 
. OVv=0 

. 0=0 

. If cv = 0, then c = O or v = 0. 

. —(-v)=v 


PROOF 


To prove the first property, assume v + u = v. Then Theorem 4.2 justifies the steps below. 


v+u=v 
(v+u) + (-v)=v+(-v) 

(v + u) +(-v7)=0 

(u + v) + (—v) =0 

u+([v+(-v)]=0 

u+0=0 

u=0 


Given 

Add —v to both sides. 
Additive inverse 
Commutative property 
Associative property 
Additive inverse 


Additive identity 


To prove the second property, assume v + u = 0, and again use Theorem 4.2 to justify 
the steps below. 


v+u=0 Given 
(—v) + (v+u = (—v) + 0 Add —y to both sides. 
(-v) + (v +u) = -v Additive identity 


[(-v) +v] +u = -v Associative property 


0+u= -yvy Additive inverse 
u+0= -v Commutative property 
u= -y Additive identity 


As you gain experience in reading and writing proofs involving vector algebra, you will 
not need to list as many steps as shown above. For now, however, it is a good idea to 
list as many steps as possible. The proofs of the other four properties are left as 
exercises. (See Exercises 65-68.) | 


LINEAR 
ALGEBRA 
APPLIED 


Vectors have a wide variety of 
applications in engineering and 

the physical sciences. For example, (2 
to determine the amount of force W 
required to pull an object up a 

ramp that has an angle of elevation 

0, use the figure at the right. F 


In the figure, the vector labeled W represents the weight of 
the object, and the vector labeled F represents the required 
force. Using similar triangles and some trigonometry, the 
required force is F = W sin 8. (Verify this.) 


Anne Kitzman/Shutterstock.com 
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Chapter 4 Vector Spaces 


DISCOVERY 


1. Is the vector (1, 1) a 


linear combination of 
the vectors (1, 2) and 
(—2, —4)? Graph 
these vectors and 
explain your answer 
geometrically. 


Similarly, determine 
whether the vector 

(1, 1) is a linear 
combination of the 
vectors (1, 2) and (2, 1). 


What is the geometric 
significance of 
questions 1 and 2? 


Is every vector in R? a 
linear combination of 
the vectors (1, —2) 
and (—2, 1)? Give a 
geometric explanation 
for your answer. 


See LarsonLinearAlgebra.com 
for an interactive version 
of this type of exercise. 


Copyright 2017 C 
Editorial review has d 


e Learning. All Ri 
ned that any suppr 


d content d 


LINEAR COMBINATIONS OF VECTORS 


An important type of problem in linear algebra involves writing one vector x as the 
sum of scalar multiples of other vectors v,, V>,. . ., and v,. That is, for scalars c}, 
Cani ra Coa 


a CV 


n'n 


X= cV + CoV. t: 
The vector x is called a linear combination of the vectors v,, V3, . . 
EXAMPLE 6 
Let x = (—1, —2, — 2), u = (0, 1, 4), v = (—1, 1, 2), and w = (3, 1, 2) in R?. Find 

scalars a, b, and c such that 


., and v,. 


Writing a Vector as a Linear 
Combination of Other Vectors 


x = au + bv + cw. 


SOLUTION 
Write 
x u v w 
oo oo mA a 
(—1, —2, —2) = a(0, 1, 4) + b(—1, 1, 2) + c(3, 1, 2) 


=(-b+3c,at+b+c,4a + 2b + 2c) 


and equate corresponding components so that they form the system of three linear 
equations in a, b, and c shown below. 

=p 36> — 1, 

a+ b+ ¢==2 

4a + 2b + 2c = -2 


Equation from first component 
Equation from second component 
Equation from third component 
Solve for a, b, and c to get a = 1, b = —2, and c = — 1. As a linear combination of 
u, v, and W, 
xX =u-2v-w. 


Use vector addition and scalar multiplication to check this result. m 


You will often find it useful to represent a vector u = (u;, Up, . . ., u) in 
R” as either a 1 x n row matrix (row vector) or an n x 1 column matrix (column 
vector). This approach is valid because the matrix operations of addition and scalar 
multiplication give the same results as the corresponding vector operations. That is, 
the matrix sums 


ut+tv=[u, uw We [vi v oc v] 


=[u, +v m +v u, + v] 
and 
Uy vi u + vy 
U, Va u, + V, 


yield the same results as the vector operation of addition, 


i u,) + (v, Vape Tg v,) 


+ $53 H V) 


u + v = (u; u,.. 
= (u; + Vi, Uy + Vz. 


The same argument applies to scalar multiplication. The only difference in each set of 
notations is how the components (entries) are displayed. 
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4.1 Exercises 


4.1 Exercises 159 


See CalcChat.com for worked-out solutions to odd-numbered exercises. 


Finding the Component Form of a Vector In 
Exercises 1 and 2, find the component form of the vector. 


1. y 2. y 


>x 


x 


Representing a Vector In Exercises 3—6, use a directed 
line segment to represent the vector. 


3. u = (2, —4) 4. v = (—2, 3) 
5. u = (—3, —4) 6. v = (—2, —5) 
Finding the Sum of Two Vectors In Exercises 7-10, 


find the sum of the vectors and illustrate the sum 
geometrically. 


7.u=(1,3),v=(2,-2) 8 u=(-1,4),v= (4, —3) 
9. u = (2, —3), v = (—3, — 1) 
10. u = (4, — 2), v = (—2, — 3) 


Vector Operations In Exercises 11-16, find the 
vector v and illustrate the specified vector operations 
geometrically, where u = (—2, 3) and w = (—3, —2). 
11. v = 3u 12,.v=u+w 

13. v = u + 2w 14. v=-u+w 


15. v = 3(3u + w) 16. v = u — 2w 


17. For the vector v = (2, 1), sketch (a) 2v, (b) — 3v, and 
(c) 3v. 

18. For the vector v = (3, — 2), sketch (a) 4v, (b) - iy, and 
(c) Ov. 


Vector Operations In Exercises 19-24, let u = (1, 2, 3), 

v = (2, 2, — 1), and w = (4, 0, — 4). 

19. Find u — v and v — u. 20. Findu — v + 2w. 

21. Find 2u + 4v — w. 22. Find 5u — 3v — $w. 

23. Find z, where 3u — 4z = w. 

24. Find z, where 2u + v — w + 3z = 0. 

25. For the vector v = (1, 2, 2), sketch (a) 2v, (b) — v, and 
(c) 4v. 

26. For the vector v = (2, 0, 1), sketch (a) — v, (b) 2v, and 
(c) 3v. 

27. Determine whether each vector is a scalar multiple of 
z = (3,2, —5). 


(a) v=(3,3,-98) ) w= (9, -6, -15) 


28. Determine whether each vector is a scalar multiple of 
z = (5 73, 3). 
(a) u = (6, — 4, 9) 
a=k 
Vector Operations In Exercises 29-32, find (a) u — v, 
(b) 2(u + 3v), and (c) 2v — u. 
29. u = (4,0, —3, 5), v = (0,2,5,4) 
30. u = (0, 4, 3,4,4), v = (6,8, —3, 3, —5) 
31. u = (—7, 0,0,0,9), v = (2, —3, —2, 3, 3) 
32. u = (6, —5, 4,3), v=(-2,3,-4-1) 


BY vector Operations In Exercises 33 and 34, use a 


graphing utility to 
where u = (1, 2, —3, 1), 
w = (2, —2, 1,3). 
33. (a) u + 2v 34. (a) v + 3w 

(b) w — 3u (b) 2w — ju 

(c) 4v + ju — w (c) H4y — 3u + w) 


perform each operation 
v = (0,2,—1,—2), and 


Solving a Vector Equation In Exercises 35-38, solve 
for w, where u = (1, —1, 0, 1) and v = (0, 2, 3, — 1). 


35. 3w = u — 2v 36. w+u= -v 
37. 5w = 2u + 3v 38. w + 3v = —2u 


Solving a Vector Equation In Exercises 39 and 40, 
find w such that 2u + v — 3w = 0. 


39. u = (0,2,7,5), v = (—3, 1,4, —8) 
40. u = (—6, 0,2,0), v = (5, —3, 0, 1) 
Writing a Linear Combination In Exercises 41-46, 


write v as a linear combination of u and w, if possible, 
where u = (1, 2) and w = (1, — 1). 


41. v = (2, 1) 42. v = (0,3) 
43. v = (3,3) 44. v = (1, —1) 
45. v = (—1, —2) 46. v = (1, —4) 


Writing a Linear Combination In Exercises 47-50, 
write v as a linear combination of u,, u,, and u,, if 
possible. 
47. v = (10, 1,4), u, = (2,3,5), w = (1,2, 4), 
Us = (=2, 2; 3) 
48. v= (= l, 7, 2), u; = (G, 3, 5); u, = (2, = 1, 3), 
u, = (=3, 2, —4) 
49. v = (0,5, 3,0), u =(1,1,2,2), w = (2, 3,5, 6), 
u, = (3, 1, —4, 2) 
50. v = (7, 2,5, —3), u = 1 
u, = (—3, 3,4, —5), u, = (—6, 3, 1, 2) 


— 
= 
N 

Sot 
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Writing a Linear Combination In Exercises 51 and 
52, write the third column of the matrix as a linear 
combination of the first two columns, if possible. 


1 2 3 i 2 3 
51.17 8 9 52.17 8 9 
4 5 6 4 5 7 


Ae Writing a Linear Combination In Exercises 53 and 

© 54, use a software program or a graphing utility to write 
v as a linear combination of u,, u,, U}, U4, and u;. Then 
verify your solution. 


53. — —11, 11,9) 54. v= (5,8,7, —2, 4) 


= (1, -—1) u, = (1,1, — 1, 2, 1) 
= (1, 2.0.2.1) u, = (2, 1,2, —1, 1) 
= (0, - —4) u, = (1, 2, 0, 1, 2) 

= (2,1, —1,2, 1) u, = (0, 2, 0, 1, —4) 
e =] =i) u; = (1, 1, 2, — 1, 2) 


Writing a Linear Combination In Exercises 55 and 
56, the zero vector 0 = (0,0,0) can be written as a 
linear combination of the vectors v,, v,, and v, because 
0 = Ov, + Ov, + Ov;. This is the trivial solution. Find a 
nontrivial way of writing 0 as a linear combination of the 
three vectors, if possible. 


55. v, = (1,0, 1), v>=(-1,1,2), v3 = (0,1,4) 
56. v, = (1,0, 1), v,=(-1,1,2), v, = (0, 1,3) 


True or False? In Exercises 57 and 58, determine 
whether each statement is true or false. If a statement 
is true, give a reason or cite an appropriate statement 
from the text. If a statement is false, provide an example 
that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


57. (a) Two vectors in R” are equal if and only if their 
corresponding components are equal. 


(b) The vector —v is the additive identity of v. 


58. (a) To subtract two vectors in R”, subtract their 
corresponding components. 


(b) The zero vector 0 in R” is the additive inverse of a 
vector. 


59. Writing Let Ax = b be a system of m linear equations 
in n variables. Designate the columns of A as a, 
a,,. ..,a,. When b is a linear combination of these 
n column vectors, explain why this implies that the 
linear system is consistent. What can you conclude about 
the linear system when b is not a linear combination of 
the columns of A? 


60. Writing How could you describe vector subtraction 
geometrically? What is the relationship between vector 
subtraction and the basic vector operations of addition 
and scalar multiplication? 


61. Illustrate properties 1-10 of Theorem 4.2 for 
u = (2, -1,3,6), v= (1,4,0,1), w = (3,0, 2,0), 
c =5,andd = —2. 


62. CAPSTONE Consider the vectors 
u = (3, —4) and v = (9, 1). 

(a) Use directed line segments to represent each 
vector graphically. 

(b) Find u + v. 

(c) Find 2v — u. 


(d) Write w = (39,0) as a linear combination of u 
and v. 


63. Proof Complete the proof of Theorem 4.1. 


64. Proof Prove each property of vector addition and 
scalar multiplication from Theorem 4.2. 


Proof In Exercises 65-68, complete the proofs of the 
remaining properties of Theorem 4.3 by supplying the 
justification for each step. Use the properties of vector 
addition and scalar multiplication from Theorem 4.2. 


65. Property 3: Ov = 0 


Ov = (0 + O)v a 
Ov = Ov + Ov b, = 
Ov + (—Ov) = (Ov + Ov) + (— 0v) Üo 
0 = Ov + (Ov + (—0v)) do 
0=0v+0 nr 
0 = Ov He 
66. Property 4: c0 = 0 

c0 = c(0 + 0) a 
c0 = c0 + c0 Di i 

c0 + (—c0) = (c0 + c0) + (—c0) c. 
0 = c0 + (c0 + (—c0)) do 
0=c0+0 Eron 

0= c0 f. 


67. Property 5: If cv = 0, then c = 0 or v = 0. If c = 0, 
then you are done. If c # 0, then c™! exists, and you have 


—(-yvy)+0=v+0 


—(-v) =v 


c ev) =c'0 a 

(tev = 0 b. 

lv=0 G; 

v=0. d. 

68. Property 6: —(—v) = v 

(—v) + (—v) = 0 and v + (—v) = a: 
(=v) + (-v) =v + (-v) — 

—(-v) + (-v) +v=v+(-v) + c. 
=v) + (=v) + y) = v + ((- e — 

f. 
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4.2 Vector Spaces 


zi Define a vector space and recognize some important vector spaces. 
ȘI Show that a given set is not a vector space. 


DEFINITION OF A VECTOR SPACE 


Theorem 4.2 lists ten properties of vector addition and scalar multiplication in R”. 
Suitable definitions of addition and scalar multiplication reveal that many other 
mathematical quantities (such as matrices, polynomials, and functions) also share these 
ten properties. Any set that satisfies these properties (or axioms) is called a vector 
space, and the objects in the set are vectors. 

It is important to realize that the definition of a vector space below is precisely 
that—a definition. You do not need to prove anything because you are simply listing 
the axioms required of vector spaces. This type of definition is an abstraction because 
you are abstracting a collection of properties from a particular setting, R”, to form the 
axioms for a more general setting. 


Definition of a Vector Space 


Let V be a set on which two operations (vector addition and scalar 
multiplication) are defined. If the listed axioms are satisfied for every u, v, and 
w in V and every scalar (real number) c and d, then V is a vector space. 


Addition: 
. u + visin V. Closure under addition 
~-utv=vtu Commutative property 
.ut(vt+tw)=(ut+yv+w Associative property 
. V has a zero vector 0 such that for Additive identity 


everyuinV,u+0=u. 

. For every u in V, there is a vector Additive inverse 
in V denoted by —u such that 
u + (—u) = 0. 


Scalar Multiplication: 


. cuis in V. Closure under scalar multiplication 
. ctu + v) = cu + cv Distributive property 

. (c + dju = cu + du Distributive property 

. c(du) = (cd)u Associative property 

. 1(u)= u Scalar identity 


It is important to realize that a vector space consists of four entities: a set of 
vectors, a set of scalars, and two operations. When you refer to a vector space V, be sure 
that all four entities are clearly stated or understood. Unless stated otherwise, assume 
that the set of scalars is the set of real numbers. 

The first two examples of vector spaces should not be surprising. They are, in fact, 
the models used to form the ten vector space axioms. 


'i R? with the Standard Operations 
EXAMPLE 1 Is a Vector Space 


The set of all ordered pairs of real numbers R? with the standard operations is a vector 
space. To verify this, look back at Theorem 4.1. Vectors in this space have the form 


v = (vp v2). | 
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REMARK 


From Example 2 you can 
conclude that A’, the set of 
real numbers (with the usual 
operations of addition and 
multiplication), is a vector 
space. 


REMARK 


In the same way you are able 
to show that the set of all 2 x 3 
matrices is a vector space, you 
can show that the set of all 

m x n matrices, denoted by 

is a vector space. 


M, 


m,n 


REMARK 


Even though the zero 
polynomial 0(x) = 0 has no 
degree, P, is often called the 
set of all polynomials of 
degree 2 or less. 


z m] R" with the Standard Operations 
EXAMPLE 2 Is a Vector Space 


The set of all ordered n-tuples of real numbers R” with the standard operations is a 
vector space. Theorem 4.2 verifies this. Vectors in this space are of the form 


V = (Vi Va V3. © +s Vp): | 


The next three examples describe vector spaces in which the basic set V does 
not consist of ordered n-tuples. Each example describes the set V and defines the two 
vector operations. To show that the set is a vector space, you must verify all ten axioms. 


EXAMPLE 3 The Vector Space of All 2 x 3 Matrices 


Show that the set of all 2 x 3 matrices with the operations of matrix addition and scalar 
multiplication is a vector space. 


SOLUTION 


If A and B are 2 x 3 matrices and c is a scalar, then A + B and cA are also 2 x 3 
matrices. The set is, therefore, closed under matrix addition and scalar multiplication. 
Moreover, the other eight vector space axioms follow directly from Theorems 2.1 and 
2.2 (see Section 2.2). So, the set is a vector space. Vectors in this space have the form 


a a a 
3 
a=A= | n Me i | ui 
G4, Ay Ay 


EXAMPLE 4 The Vector Space of All Polynomials 
of Degree 2 or Less 


Let P, be the set of all polynomials of the form p(x) = ay + a,x + a,x?, where do, 
a,, and a, are real numbers. The sum of two polynomials p(x) = dy + a,x + a,x? and 
q(x) = by + b,x + b,x? is defined in the usual way, 


P(x) + g(x) = (ay + bo) + (a, + bi)x + (ay + by)x? 


and the scalar multiple of p(x) by the scalar c is defined by 
cp(x) = cay + cayx + ca,x?. 
Show that P, is a vector space. 


SOLUTION 
Verification of each of the ten vector space axioms is a straightforward application of 
the properties of real numbers. For example, the set of real numbers is closed under 
addition, so it follows that a, + bọ, a, + b,, and a, + b, are real numbers, and 
p(x) + g(x) = (ay + bo) + (a, + b,)x + (a, + b,)x? 
is in the set P, because it is a polynomial of degree 2 or less. So, P, is closed under 
addition. To verify the commutative property of addition, write 
p(x) + q(x) = (ag + a,x + a,x?) + (by + bix + b,x?) 
= (dg + bo) + (ay + bi)x + (a, By)? 
= (b) + ap) + (b; Pale + (b, + ale 
= (by + bix + bax?) + (ag + ax + a,x?) 
= (x) + p(x). 
Can you see where the commutative property of addition of real numbers was 


used? The zero vector in this space is the zero polynomial O(x) = 0 + Ox + 0x. 
Verify the other vector space axioms to show that P, is a vector space. 
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Pis defined as the set of all polynomials of degree n or less (together with the zero 
polynomial). The procedure used to verify that P, is a vector space can be extended to 
show that P,,, with the usual operations of polynomial addition and scalar multiplication, 
is a vector space. 


EXAMPLE 5 The Vector Space of Continuous 
Functions (Calculus) 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 
Let C(— o0, 00) be the set of all real-valued continuous functions defined on the 
entire real line. This set consists of all polynomial functions and all other continuous 


functions on the entire real line. For example, f(x) = sin x and g(x) = e* are members 
of this set. 7 


A 
Addition is defined by 
(f + g)(x) = fe) + g(x) 


as shown at the right. Scalar multiplication is 
defined by J + 8) 4 


(cf)(x) = dfw]. 


Show that C(— 00, 00) is a vector space. 


SOLUTION 


To verify that the set C(— 00, 00) is closed under addition and scalar multiplication, use a 
result from calculus—the sum of two continuous functions is continuous and the product 
of a scalar and a continuous function is continuous. To verify that the set C(— oo, co) 
has an additive identity, consider the function fy that has a value of zero for all x, that is, 


fo(x) = 0, x is any real number. 


This function is continuous on the entire real line (its graph is simply the line y = 0), 
which means that it is in the set C(— o0, 00). Moreover, if f is any other function that 
is continuous on the entire real line, then 


(fF + fo)(x) = f(x) + fol) = f(x) + 0 = fC). 


This shows that fj is the additive identity in C(— 00, 00). The verification of the other 
vector space axioms is left to you. | 


The summary below lists some important vector spaces frequently referenced in 
the remainder of this text. The operations are the standard operations in each case. 


Summary of Important Vector Spaces 


= set of all real numbers 
set of all ordered pairs 
set of all ordered triples 
set of all n-tuples 
= set of all continuous functions defined on the real number line 


= set of all continuous functions defined on a closed interval [a, b], 
where a # b 

= set of all polynomials 

= set of all polynomials of degree < n (together with the zero 
polynomial) 

= set of all m x n matrices 

= set ofall n x n square matrices 
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You have seen the versatility of the concept of a vector space. For instance, a vector 
can be a real number, an n-tuple, a matrix, a polynomial, a continuous function, and so 
on. But what is the purpose of this abstraction, and why bother to define it? There are 
several reasons, but the most important reason applies to efficiency. Once a theorem 
has been proved for an abstract vector space, you need not give separate proofs for 
n-tuples, matrices, polynomials, or other forms. Simply point out that the theorem 
is true for any vector space, regardless of the form the vectors have. Theorem 4.4 
illustrates this process. 


THEOREM 4.4 Properties of Scalar Multiplication 


Let v be any element of a vector space V, and let c be any scalar. Then the properties 
below are true. 


1. Ov =0 
3. If cv = 0, then c = O or v = 0. 


PROOF 

To prove these properties, use the appropriate vector space axioms. For example, to 
prove the second property, note from axiom 4 that 0 = 0 + 0. This allows you to write 
the steps below. 


c0 = c(0 + 0) Additive identity 
c0 = c0 + c0 Left distributive property 
c0 + (—c0) = (c0 + c0) + (— c0) Add — c0 to both sides. 
c0 + (—c0) = c0 + [c0 + (—c0)] Associative property 
0=0+0 Additive inverse 
0 = c0 Additive identity 


To prove the third property, let cv = 0. To show that this implies either c = 0 or v = 0, 
assume that c # 0. (When c = 0, you have nothing more to prove.) Now, c # 0, so you 
can use the reciprocal 1/c to show that v = 0, as shown below. 


v= 1v = (Lov l= =0 
Cc C C 


Note that the last step uses Property 2 (the one you just proved). The proofs of the first 
and fourth properties are left as exercises. (See Exercises 51 and 52.) | 


LINEAR Ina mass-spring system, motion is assumed to occur in 

ALGEBRA only the vertical direction. That is, the system has one 
degree of freedom. When the mass is pulled downward 

APPLIED and then released, the system will oscillate. If there are no 
forces present to slow or stop the oscillation, then the 
system is undamped and will oscillate indefinitely. 
Applying Newton’s Second Law of Motion to the mass 
yields the second order differential equation 


x" + w*x =0 


where x is the displacement at time t, and w is a fixed 
constant called the natural frequency of the system. The 
general solution of this differential equation is 


x(t) = a, sin wt + a, cos wt 


where a, and a, are arbitrary constants. (Verify this.) In 
Exercise 45, you are asked to show that the set of all 
functions x(t) is a vector space. 


G|PhotoStock/Science Source/Getty Images 
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SETS THAT ARE NOT VECTOR SPACES 


The remaining examples in this section describe some sets (with operations) that do not 
form vector spaces. To show that a set is not a vector space, you need only find one 
axiom that is not satisfied. 


REMARK EXAMPLE 6 The Set of Integers Is Not a Vector Space 
Notice that a single failure of 


one of the ten vector space 
axioms suffices to show that 
a set is not a vector space. 


The set of all integers (with the standard operations) does not form a vector space 
because it is not closed under scalar multiplication. For example, 

1 1 

(1) = 3. 


) ee 
Scalar Integer Noninteger | 


In Example 4, it was shown that the set of all polynomials of degree 2 or less 
forms a vector space. You will now see that the set of all polynomials whose degree is 
exactly 2 does not form a vector space. 


REMARK 


The set of all second-degree 


polynomials:is alee War closed z The Set of Second-Degree Polynomials 
under scalar multiplication. EXAMPLE 7 g y 
(Verify this.) 


Is Not a Vector Space 


The set of all second-degree polynomials is not a vector space because it is not closed 
under addition. To see this, consider the second-degree polynomials p(x) = x? and 
q(x) = 1 + x — x?, whose sum is the first-degree polynomial p(x) + q(x) = 1 + x. 


The sets in Examples 6 and 7 are not vector spaces because they fail one or both 
closure axioms. In the next example, you will look at a set that passes both tests for 
closure but still fails to be a vector space. 


EXAMPLE 8 A Set That Is Not a Vector Space 


Let V = R’, the set of all ordered pairs of real numbers, with the standard operation of 
addition and the nonstandard definition of scalar multiplication listed below. 


cle, x) E (cx,, 0) 
Show that V is not a vector space. 


SOLUTION 


In this example, the operation of scalar multiplication is nonstandard. For instance, the 
product of the scalar 2 and the ordered pair (3, 4) does not equal (6, 8). Instead, the 
second component of the product is 0, 


2(3, 4) = (2 - 3,0) = (6, 0). 


This example is interesting because it satisfies the first nine axioms of the definition 
of a vector space (show this). In attempting to verify the tenth axiom, the nonstandard 
definition of scalar multiplication gives you 


10, 1) = (1,0) + (1, 1). 


The tenth axiom is not satisfied and the set (together with the two operations) is not a 
vector space. | 


Do not be confused by the notation used for scalar multiplication in Example 8. 
In writing c(x,, x2) = (cx, 0), the scalar multiple of (x,, x) by c is defined to be (cx,, 0) 
in this example. 
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Chapter 4 Vector Spaces 


4.2 Exercises See CalcChat.com for worked-out solutions to odd-numbered exercises. 


Describing the Additive Identity In Exercises 1-6, 
describe the zero vector (the additive identity) of the 
vector space. 


1. Rt 2. C[-1,0] 
3. M33 4. Ms, 
5. P; 6. M,, 


Describing the Additive Inverse In Exercises 7-12, 
describe the additive inverse of a vector in the vector 


space. 

7. R 8. C(— o0, co) 
9. M, 10. M, 4 

11. P, 12. M; 


Testing for a Vector Space In Exercises 13-36, 
determine whether the set, together with the standard 
operations, is a vector space. If it is not, identify at least 
one of the ten vector space axioms that fails. 


13. My 
14. M,, 
15. The set of all third-degree polynomials 
16. The set of all fifth-degree polynomials 


17. The set of all first-degree polynomial functions ax, 
a + 0, whose graphs pass through the origin 


18. The set of all first-degree polynomial functions ax + b 
a, b # 0, whose graphs do not pass through the origin 


19. The set of all polynomials of degree four or less 


20. The set of all quadratic functions whose graphs pass 
through the origin 


21. The set 
{(x, y): x 2 0, y is a real number} 
22. The set 
{(x, y): x 2 0, y = 0} 
23. The set 
{(x, x): x is a real number} 
24. The set 
{ (x, tx): x is a real number} 
25. The set of all 2 x 2 matrices of the form 
je 
c 0 
26. The set of all 2 x 2 matrices of the form 


E 


27. 


28. 


29. 


30. 


3L 
32. 
33. 
34. 
35. 


36. 


37. 


38. 


39. 


ee |: 


The set of all 3 x 3 matrices of the form 
(0) a b 
Cc 0 d 
e f 0 
The set of all 3 x 3 matrices of the form 
1 a b 
c 1 d 
e f 1 
The set of all 4 x 4 matrices of the form 
0 a b c 
a 0 b Ê 
a b (0) c 
a b C 1 
The set of all 4 x 4 matrices of the form 
(0) a b Cc 
a 0 b c 
a b (0) c 
a b c 0 


The set of all 2 x 2 singular matrices 

The set of all 2 x 2 nonsingular matrices 
The set of all 2 x 2 diagonal matrices 

The set of all 3 x 3 upper triangular matrices 


C[0, 1], the set of all continuous functions defined on 
the interval [0, 1] 

C|- 1, 1], the set of all continuous functions defined on 
the interval [—1, 1] 


Let V be the set of all positive real numbers. Determine 
whether V is a vector space with the operations shown 
below. 
x+y =xy 

Cx x 
If it is, verify each vector space axiom; if it is not, state 
all vector space axioms that fail. 


Addition 


Scalar multiplication 


Determine whether the set R? with the operations 


(x1, 91) + (x5, y2) = (x Yio) 


and 


e(x,, yı) = (cx, ey,) 
is a vector space. If it is, verify each vector space axiom; 
if it is not, state all vector space axioms that fail. 


Proof Prove in full detail that the set {(x, 2x): x is a 
real number}, with the standard operations in R?, is a 
vector space. 
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40. Proof Prove in full detail that M,,, with the standard 
operations, is a vector space. 46. CAPSTONE 


41. Rather than use the standard definitions of addition (a) Describe the conditions under which a set may be 
and scalar multiplication in R’, let these two operations classified as a vector space. 
be defined as shown below. (b) Give an example of a set that is a vector space and 
an example of a set that is not a vector space. 


(a) xry) + (2, y2) = Oy + x23 y1 + y2) 
e(x, y) = (cx, y) 
(b) (x,, y1) + @ y2) = (,, 0) 47. Proof Complete the proof of the cancellation property 


c(x, y) = (ex, cy) of vector addition by justifying each step. 


(c) (x, y) + (5, ya) = (x) + a y, + y) Prove that if u, v, and w are vectors in a vector space V 
D Y1 PIA 1 2971 2 


such that u + w = v + w, then u = v. 
clx, y) = (Vex, cy) 


u+tw=vtw 
With each of these new definitions, is R? a vector space? 


Justify your answers. (a+ w) + (w= + w) + Cw) ~ 
42. Rather than use the standard definitions of addition and br: (=e) St ae tm) De 
scalar multiplication in R°, let these two operations be ut+0=v+0 
defined as shown below. u=v d. 
(a) (x1, Yp Z) + (os Ya z) 48. Let R® be the set of all infinite sequences of real 
= (x, + x y, + Yor z + z) numbers, with the operations 
c(x, y, z) = (cx, cy, 0) u + v = (u, W, us.» .) + (Vi, Va Vy. .) 
(b) (p Yp z) + (Xs Y» z2) = (0, 0, 0) = (u, + vi, U3 + Va, U3 + V3...) 
c(x, y, z) = (cx, cy, cz) and 
(c) Xr Yr Z) + Ga Ya Z2) cu = C(Uy, U5, U3,. . .) 
= (ta tl, y ty +l, z +z +1) = (Cuj, Cuz, Cuz, . . .). 
cla, y, z) = (cx, cy, cz) Determine whether R® is a vector space. If it is, verify 
(4) (1, Yi, 21) + Br» Yo, Z2) each vector space axiom; if it is not, state all vector 
=a tl, y ty +l, z +z +1) space axioms that fail. 
elx, y, z) = (ex + c — 1,cy +c- 1,cz +c- 1) 

. o. z og True or False? In Exercises 49 and 50, determine 
ve cach of these new definitions, sity a vectorspace? whether each statement is true or false. If a statement 
Justify yout answers: is true, give a reason or cite an appropriate statement 

43. Prove that in a given vector space V, the zero vector is from the text. If a statement is false, provide an example 
unique. that shows the statement is not true in all cases or cite an 
44. Prove that in a given vector space V, the additive appropriate statement from the text. 
inverse of a vector is unique. 49. (a) A vector space consists of four entities: a set of 
45. Mass-Spring System The mass in a mass-spring vectors, a set of scalars, and two operations. 
system (see figure) is pulled downward and then (b) The set of all integers with the standard operations 
released, causing the system to oscillate according to is a vector space. 
x(t) = a, sin wt + a, cos wt (c) The set of all ordered triples (x,y,z) of real 


numbers, where y = 0, with the standard operations 


where x is the displacement at time t, a, and a, are 3: 
on R? is a vector space. 


arbitrary constants, and w is a fixed constant. Show that 


the set of all functions x(t) is a vector space. 50. (a) To show that a set is not a vector space, it is 


sufficient to show that just one axiom is not 
satisfied. 


(b) The set of all first-degree polynomials with the 
standard operations is a vector space. 


(c) The set of all pairs of real numbers of the form 
(0, y), with the standard operations on R?, is a 
vector space. 


51. Proof Prove Property 1 of Theorem 4.4. 


52. Proof Prove Property 4 of Theorem 4.4. 
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4.3 Subspaces of Vector Spaces 


REMARK 


Note that if W is a subspace of 
V, then it must be closed under 
the operations inherited from V. 


x 


Figure 4.7 


wi Determine whether a subset W of a vector space V is a subspace 
of V. 


J Determine subspaces of R”. 


SUBSPACES 


In many applications in linear algebra, vector spaces occur as subspaces of larger 
spaces. For instance, you will see that the solution set of a homogeneous system of 
linear equations in n variables is a subspace of R”. (See Theorem 4.16.) 

A nonempty subset of a vector space is a subspace when it is a vector space with 
the same operations defined in the original vector space, as stated in the next definition. 


Definition of a Subspace of a Vector Space 


A nonempty subset W of a vector space V is a subspace of V when W is a vector 
space under the operations of addition and scalar multiplication defined in V. 


EXAMPLE 1 A Subspace of R? 


Show that the set W = {(x,, 0, x3): x, and x, are real numbers} is a subspace of R? with 
the standard operations. 


SOLUTION 


The set W is nonempty because it contains the zero vector (0, 0, 0). 

Graphically, the set W can be interpreted as the xz-plane, as shown in Figure 4.7. 
The set W is closed under addition because the sum of any two vectors in the xz-plane 
must also lie in the xz-plane. That is, if (x,, 0, x3) and (y,, 0, y3) are in W, then their sum 
(x, + y,,0,x,; + y3) is also in W. Similarly, to see that W is closed under scalar 
multiplication, let (x,, 0, x3) be in W and let c be a scalar. Then c(x,, 0, x3) = (cx,, 0, cx3) 
has zero as its second component and must be in W. The verifications of the other eight 
vector space axioms are left to you. | 


To establish that a set W is a vector space, you must verify all ten vector space 
axioms. If W is anonempty subset of a larger vector space V (and the operations defined 
on W are the same as those defined on V), however, then most of the ten properties are 
inherited from the larger space and need no verification. The next theorem states that it 
is sufficient to test for closure in order to establish that a nonempty subset of a vector 
space is a subspace. 


THEOREM 4.5 Test for a Subspace 


If W is a nonempty subset of a vector space V, then W is a subspace of V if and 


only if the two closure conditions listed below hold. 


1. If u and v are in W, then u + vis in W. 
2. If wis in W and c is any scalar, then cu is in W. 


PROOF 


The proof of this theorem in one direction is straightforward. That is, if W is a subspace 
of V, then W is a vector space and must be closed under addition and scalar multiplication. 
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REMARK 


Note that if W is a subspace 
of a vector space V, then both 
W and V must have the same 
zero vector 0. (In Exercise 55, 
you are asked to prove this.) 
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To prove the theorem in the other direction, assume that W is closed under addition 
and scalar multiplication. Note that if u, v, and w are in W, then they are also in V. 
Consequently, vector space axioms 2, 3, 7, 8, 9, and 10 are satisfied automatically. W is 
closed under addition and scalar multiplication, so it follows that for any v in W and scalar 
c = 0, cv = 0, and (— 1)v = —v both lie in W, which satisfies axioms 4 and 5. | 


A subspace of a vector space is also a vector space, so it must contain the zero 
vector. In fact, the simplest subspace of a vector space V is the one consisting of only 
the zero vector, W = {0}. This subspace is the zero subspace. Another subspace of V 
is V itself. Every vector space contains these two trivial subspaces, and subspaces other 
than these are called proper (or nontrivial) subspaces. 


EXAMPLE 2 A Subspace of M, , 


Let W be the set of all 2 x 2 symmetric matrices. Show that W is a subspace of 
the vector space M,,, with the standard operations of matrix addition and scalar 
multiplication. 


SOLUTION 


Recall that a square matrix is symmetric when it is equal to its own transpose. The set 
M,, is a vector space, so you only need to show that W (a subset of M,,) satisfies 
the conditions of Theorem 4.5. Begin by observing that W is nonempty. W is closed 
under addition because for matrices A, and A, in W, A, = Aj and A, = AJ, which 
implies that 


(A, +A)? = AP + AT =A, + A, 


So, if A, and A, are symmetric matrices of order 2, then so is A, + A). Similarly, W is 
closed under scalar multiplication because A = A’ implies that (cA) = cA’ = cA. If 
A is a symmetric matrix of order 2, then so is cA. | 


The result of Example 2 can be generalized. That is, for any positive integer n, the 
set of symmetric matrices of order n is a subspace of the vector space M_,,, with the 


n,n 


standard operations. The next example describes a subset of M, „ that is not a subspace. 


The Set of Singular Matrices 
EXAMPLE 3 Is Not a Subspace of M,,,, 


Let W be the set of singular matrices of order 2. Show that W is not a subspace of M, > 
with the standard operations. 


SOLUTION 


By Theorem 4.5, to show that a subset W is not a subspace, show that W is empty, 
W is not closed under addition, or W is not closed under scalar multiplication. In this 
example, W is nonempty and closed under scalar multiplication, but it is not closed 
under addition. To see this, let A and B be 


1 0 0 0 
asli A and pii iL 


Then A and B are both singular (noninvertible), but their sum 


1 0 
A+B=|) 9 


is nonsingular (invertible). So W is not closed under addition, and by Theorem 4.5, W 
is not a subspace of M, ,. | 
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EXAMPLE 4 A Subset of R? That Is Not a Subspace 


Show that W = {(x,,x,): x, = 0 and x, = O}, with the standard operations, is not a 
subspace of R?. 


SOLUTION 


This set is nonempty and closed under addition. It is not, however, closed under 
scalar multiplication. To see this, note that (1,1) is in W, but the scalar multiple 
(—1)d, 1) = (—1, —1) is not in W. So W is not a subspace of R?. | 


You will often encounter sequences of nested subspaces. For example, consider 
the vector spaces Po, Pi, Pa, P3,. . .,P,, where P, is the set of all polynomials of 
degree less than or equal to k, with the standard operations. You can write 
PoC P, C P, CPC- C Pa If j S k, then P, is a subspace of P,. (In Exercise 
45, you are asked to show this.) Example 5 describes another nesting of subspaces. 


EXAMPLE 5 Subspaces of Functions (Calculus) 


Let W, be the vector space of all functions defined on [0, 1], and let W, W», W3, and 
W, be defined as shown below. 


W4 
Integrable 
functions 


W3 
Continuous 
functions 


W, = set of all polynomial functions that are defined on [0, 1] 


W, = set of all functions that are differentiable on [0, 1] 


W, = set of all functions that are continuous on [0, 1] 


wz W, = set of all functions that are integrable on [0, 1] 


Differentiable 
functions 


Show that W, C W, C W; C W, C W; and that W; is a subspace of W, fori S j. 
SOLUTION 


From calculus you know that every polynomial function is differentiable on [0, 1]. So, 
W, C W,. Moreover, every differentiable function is continuous, every continuous 
function is integrable, and every integrable function is a function, which means that 
W, C W, C W, C Ws. So, you have W, C W, C W, C W, C W,, as shown in 
Figure 4.8 Figure 4.8. It is left to you to show that W, is a subspace of W, for i = j. (See 
Exercise 46.) 


Wi 
Polynomial 
functions / 


As implied in Example 5, if U, V, and W are vector spaces such that W is a 

subspace of V and V is a subspace of U, then W is also a subspace of U. The next 

REMARK theorem states that the intersection of two subspaces is also a subspace, as shown in 
Figure 4.9. 


Theorem 4.6 states that the 
intersection of two subspaces 


is a subspace. In Exercise 56 THEOREM 4.6 The Intersection of Two Subspaces 
you are asked to show that the Is a Subspace 
union of two subspaces is not 


necessarily a subspace. If V and W are both subspaces of a vector space U, then the intersection of V and 
W (denoted by V N W) is also a subspace of U. 


PROOF 


V and W are both subspaces of U, so both contain 0, and V N W is nonempty. To show 
that VN W is closed under addition, let v} and v, be any two vectors in VM W. V and 
W are both subspaces of U, which means that both are closed under addition. Both v, 
and v, are in V, so their sum v, + v, must be in V. Similarly, v} + v, is in W because 
both v, and v, are also in W. But this implies that v, + v, is in VN W, and it follows 
Figure 4.9 The intersection of two that VN W is closed under addition. It is left to you to show (by a similar argument) 
subspaces is a subspace. that V N W is closed under scalar multiplication. (See Exercise 59.) | 
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Figure 4.10 


The unit circle is 
not a subspace 


0-1) of R2. 


Figure 4.12 


REMARK 


Another way to tell that the 
subset shown in Figure 4.12 
is not a subspace of R? is by 
noting that it does not contain 
the zero vector (the origin). 
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SUBSPACES OF R” 


R” is a convenient source for examples of vector spaces, so the remainder of this section 
is devoted to looking at subspaces of R”. 


EXAMPLE 6 Determining Subspaces of R? 


Determine whether each subset is a subspace of R?. 


a. The set of points on the line x + 2y = 0 
b. The set of points on the line x + 2y = 1 


SOLUTION 


a. Solving for x, a point in R? is on the line x + 2y = 0 if and only if it has the form 
(—2z, t), where t is any real number. (See Figure 4.10.) 


To show that this set is closed under addition, let v, = (—2r,, ¢,) and v, = (—2t,, t) 
be any two points on the line. Then you have 
v, t+ vo = (2t, t,) + (— 26, b) = (2t + b), t + b) = (— 26, t) 


where t = ti + f. vı + v, lies on the line, and the set is closed under addition. 
In a similar way, you can show that the set is closed under scalar multiplication. So, 
this set is a subspace of R?. 


b. This subset of R? is not a subspace of R? because every subspace must contain 
the zero vector (0, 0), which is not on the line x + 2y = 1. (See Figure 4.10.) i 


Of the two lines in Example 6, the one that is a subspace of R? is the one that passes 
through the origin. This is characteristic of subspaces of R?. That is, if W is a subset of 
R?, then it is a subspace if and only if it has one of the forms listed below. 


1. W consists of the single point (0, 0). 

2. W consists of all points on a line that passes through the origin. 
3. W consists of all of R?. 

Figure 4.11 shows these three possibilities graphically. 


y y y 

2 2r 

1 I 

Ei S x a "ae 
=% =] 1 2 =2 =1 1 2 
=] zee 
9 eee 
W= {(0, 0)} W = all points on a line W= R2 
passing through the origin 
Figure 4.11 


EXAMPLE 7 A Subset of R? That Is Not a Subspace 


Show that the subset of R? consisting of all points on x? + y? = 1 is not a subspace. 


SOLUTION 


This subset of R? is not a subspace because the points (1,0) and (0, 1) are in the 
subset, but their sum (1, 1) is not. (See Figure 4.12.) So, this subset is not closed 
under addition. | 
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The plane does 
not pass through 
the origin. 


The plane 
passes through 
the origin. 


(0, 0, 0) 


Figure 4.13 


Chapter 4 Vector Spaces 


EXAMPLE 8 Determining Subspaces of R°? 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


Determine whether each subset is a subspace of R°. 


a. 
b. 


W = {(x%,, x, 1): x, and x, are real numbers} 


W = {(x x1 + x3, x3): x, and x, are real numbers} 


SOLUTION 


a. 
b. 


The zero vector 0 = (0, 0, 0) is not in W, so W is not a subspace of R°. 
This set is nonempty because it contains the zero vector (0, 0, 0). Let 
v = (v vi + v, v3) and u= (u, u; + u, uz) 
be two vectors in W, and let c be any real number. W is closed under addition 
because 
v+u S= (v + u,v + v +u, + u, vy + u) 
= (v; + m, (v; + u) + (v3 + u), v3 + uz) 
= (x X] + X3, x3) 
where x, = v, + u and x, = v} + u}, which means that v + u is in W. Similarly, 
W is closed under scalar multiplication because 
cv = (cv, c(v, + v3), cv3) 
= (cv, cv, + cv3, cv3) 


= (xi X1 + x3, x3) 


where x, = cv, and x; = cv}, which means that cv is in W. So, W is a subspace 


of R°. ui 


In Example 8, note that the graph of each subset is a plane in R?, but the only subset 


that is a subspace is the one represented by a plane that passes through the origin. (See 
Figure 4.13.) You can show that a subset W of R? is a subspace of R? if and only if it 
has one of the forms listed below. 


1. 


W consists of the single point (0, 0, 0). 


2. W consists of all points on a line that passes through the origin. 
3. 
4 


. W consists of all of RÈ. 


W consists of all points in a plane that passes through the origin. 


LINEAR Digital signal processing depends on sampling, which 
ALGEBRA converts continuous signals into discrete sequences that 
APPLIED can be used by digital devices. Traditionally, sampling is 


uniform and pointwise, and is obtained from a single 
vector space. Then, the resulting sequence is reconstructed 
into a continuous-domain signal. Such a process, however, 
can involve a significant reduction in information, which 
could result in a low-quality reconstructed signal. In 
applications such as radar, geophysics, and wireless 
communications, researchers have determined situations 
in which sampling from a union of vector subspaces 

can be more appropriate. (Source: Sampling Signals from 

a Union of Subspaces—A New Perspective for the Extension of This 
Theory, Lu, Y.M. and Do, M.N., IEEE Signal Processing Magazine) 


zphoto/Shutterstock.com 
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4.3 Exercises 


Verifying Subspaces In Exercises 1-6, verify that W 
is a subspace of V. In each case, assume that V has the 
standard operations. 


1. W = {(x,, X2 X3, 0): x,, X2, and x, are real numbers} 
V= Rt 

2. {(x, y, 4x — 5y): x and y are real numbers} 
V=R 

3. W is the set of all 2 x 2 matrices of the form 


[s of 


V= M}, 
4. W is the set of all 3 x 2 matrices of the form 
a b 
a—2b 0l. 
0 c 
V = M3, 


5. Calculus W is the set of all functions that are 
continuous on [— 1, 1]. V is the set of all functions that 
are integrable on [—1, 1]. 


6. Calculus W is the set of all functions that are 
differentiable on [—1, 1]. V is the set of all functions 
that are continuous on [— 1, 1]. 


Subsets That Are Not Subspaces In Exercises 7-20, 
W is not a subspace of the vector space. Verify this by 
giving a specific example that violates the test for a 
vector subspace (Theorem 4.5). 
7. W is the set of all vectors in R? whose third component 
is —1. 
8. W is the set of all vectors in R? whose first component 
is 2. 
9. W is the set of all vectors in R? whose components are 
rational numbers. 
10. W is the set of all vectors in R? whose components are 
integers. 
11. W is the set of all nonnegative functions in C(— oo, 00). 
12. W is the set of all linear functions ax + b,a + 0, in 
C(— œ, oc). 
13. W is the set of all vectors in R? whose components are 
nonnegative. 
14. W is the set of all vectors in R? whose components are 
Pythagorean triples. 


15. W is the set of all matrices in M;, of the form 


1 a b 
c 1 d|: 
e f 0 


See CalcChat.com for worked-out solutions to odd-numbered exercises. 
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se 


El 
16. W is the set of all matrices in M, , of the form 
[Va 0 3al’, 
17. W is the set of all matrices in M,,,, with determinants 
equal to 1. 
18. W is the set of all matrices in M,,,, such that A? = A. 
19. W is the set of all vectors in R? whose second component 
is the cube of the first. 
20. W is the set of all vectors in R? whose second component 
is the square of the first. 


Determining Subspaces of C(—0co,0o) In Exercises 

21-28, determine whether the subset of C(— o0, oo) is 

a subspace of C(— œ, co) with the standard operations. 

Justify your answer. 

21. The set of all positive functions: f(x) > 0 

22. The set of all negative functions: f(x) < 0 

23. The set of all even functions: f(—x) = f(x) 

24. The set of all odd functions: f(—x) = —f(x) 

25. The set of all constant functions: f(x) = c 

26. The set of all exponential functions f(x) = a*, where 
a>0O 

27. The set of all functions such that f(0) = 0 

28. The set of all functions such that f(0) = 1 


Determining Subspaces of M,,,, In Exercises 29-36, 

determine whether the subset of M,,,, is a subspace of 

M „n With the standard operations. Justify your answer. 

29. The set of all n x n upper triangular matrices 

30. The set of all n x n diagonal matrices 

31. The set of all n x n matrices with integer entries 

32. The set of all n x n matrices A that commute with a 
given matrix B; that is, AB = BA 

33. The set of all n x n singular matrices 

34. The set of all n x n invertible matrices 

35. The set of all n x n matrices whose entries sum to zero 

36. The set of all n x n matrices whose trace is nonzero 


(Recall that the trace of a matrix is the sum of the main 
diagonal entries of the matrix.) 


Determining Subspaces of R? In Exercises 37-42, 
determine whether the set W is a subspace of R? with the 
standard operations. Justify your answer. 

37. W = {(0, x, x3): xX, and x, are real numbers} 

38. W = na Xz, 4): x, and x, are real numbers} 


39. {(a,a — 3b, b): a and b are real numbers} 

40. W = {(s,t,s + t): s and t are real numbers} 

41. W = {(x1, X2, XX2): x, and x, are real numbers} 

42. W = {(x,, 1/x,, X3): x, and x, are real numbers, x, # 0} 
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ue or False? In Exercises 43 and 44, determine 


whether each statement is true or false. If a statement 


is 


true, give a reason or cite an appropriate statement 


from the text. If a statement is false, provide an example 
that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


43 


44. 


45. 


46. 


47. 


48. 


49. 


. (a) If W is a subspace of a vector space V, then it has 
closure under scalar multiplication as defined in V. 

(b) If V and W are both subspaces of a vector space U, 
then the intersection of V and W is also a subspace. 

(c) If U, V, and W are vector spaces such that W is a 
subspace of V and U is a subspace of V, then W = U. 

(a) Every vector space V contains two proper subspaces 
that are the zero subspace and itself. 

(b) If W is a subspace of R?, then W must contain the 
vector (0, 0). 

(c) If W is a subspace of a vector space V, then it has 
closure under addition as defined in V. 

(d) If W is a subspace of a vector space V, then W is 
also a vector space. 


Consider the vector spaces 


Poy Big Pasin ee F, 


n 


where P, is the set of all polynomials of degree less than 
or equal to k, with the standard operations. Show that if 
j = k, then P; is a subspace of P,. 


Calculus Let W,, W,, W}, W,, and W, be defined as in 
Example 5. Show that W, is a subspace of W, for i = j. 


Calculus Let F(—0o, 00) be the vector space of 
real-valued functions defined on the entire real line. 
Show that each set is a subspace of F(— oo, 00). 


(a) C(—00, 00) 


(b) The set of all differentiable functions f defined on 
the real number line 


(c) The set of all differentiable functions f defined on the 
real number line that satisfy the differential equation 
f — 3f=0 


Calculus Determine whether the set 


S= {re c[o, uf to dx = o} 


is a subspace of C[0, 1]. Prove your answer. 


Let W be the subset of R? consisting of all points on a 
line that passes through the origin. Such a line can be 
represented by the parametric equations 


x=at, y=bt, and z= ct. 


Use these equations to show that W is a subspace of R°. 


50. CAPSTONE Explain why it is sufficient to 


test for closure to establish that a nonempty subset 
of a vector space is a subspace. 


51. 


52. 


53. 


54. 


55. 


56. 


57. 


58. 


59. 


Guided Proof Prove that a nonempty set W is a 
subspace of a vector space V if and only if ax + by is 
an element of W for all scalars a and b and all vectors 
x and y in W. 


Getting Started: In one direction, assume W is a 
subspace, and show by using closure axioms that 
ax + by is an element of W. In the other direction, 
assume ax + by is an element of W for all scalars a 
and b and all vectors x and y in W, and verify that W is 
closed under addition and scalar multiplication. 


(i) If W is a subspace of V, then use scalar multiplication 
closure to show that ax and by are in W. Now use 
additive closure to get the desired result. 


(ii) Conversely, assume ax + by is in W. By cleverly 
assigning specific values to a and b, show that W is 
closed under addition and scalar multiplication. 


Let x, y, and z be vectors in a vector space V. Show that 
the set of all linear combinations of x, y, and z, 


W = {ax + by + cz: a, b, and c are scalars} 


is a subspace of V. This subspace is the span of {x, y, z}. 
Proof Let A bea fixed 2 x 3 matrix. Prove that the set 


we [kera [E] 


is not a subspace of R°. 


Proof Let A bea fixed m x n matrix. Prove that the set 
W = {x E R”: Ax = 0} 
is a subspace of R”. 


Proof Let W be a subspace of the vector space V. Prove 
that the zero vector in V is also the zero vector in W. 


Give an example showing that the union of two 
subspaces of a vector space V is not necessarily a 
subspace of V. 


Proof Let A and B be fixed 2 x 2 matrices. Prove that 
the set 

W = {X: XAB = BAX} 

is a subspace of M, 5. 


Proof Let V and W be two subspaces of a vector 
space U. 


(a) Prove that the set 
V+ W={u:u=v+w,v€& Vandwe W} 


is a subspace of U. 
(b) Describe V + W when V and W are the subspaces 
of U = R?: 
V = {(x, 0): x is a real number} and W = {(0, y): y 
is a real number}. 
Proof Complete the proof of Theorem 4.6 by showing 
that the intersection of two subspaces of a vector space 
is closed under scalar multiplication. 
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4.4 Spanning Sets and Linear Independence 


Write a linear combination of a set of vectors in a vector space V. 


Determine whether a set S of vectors in a vector space Visa 
spanning set of V. 


wi Determine whether a set of vectors in a vector space V is linearly 
independent. 


LINEAR COMBINATIONS OF VECTORS IN A VECTOR SPACE 


This section begins to develop procedures for representing each vector in a vector space 
as a linear combination of a select number of vectors in the space. 


Definition of a Linear Combination of Vectors 


A vector v in a vector space V is a linear combination of the vectors u,, 
u,,. . .,U, in V when v can be written in the form 


v= cU + CU, +--+ + + Cy 


where c4, C3, . . ., C, are scalars. 


Often, one or more of the vectors in a set can be written as linear combinations of 
other vectors in the set. Examples 1 and 2 illustrate this possibility. 


EXAMPLE 1 Examples of Linear Combinations 


a. For the set of vectors in R? 
vi vV v 
S = {(1, 3, 1), (0, 1, 2), (1, 0, —5)} 
v; is a linear combination of v, and v, because 
vi = 3v, + v, = 3(0, 1,2) + (1,0, —5) = (1, 3, 1). 
b. For the set of vectors in M, 5 
vi Vz V3 V4 
se(i ahr apai aba al 
2 LE 0 1 2 IL 3 
v; is a linear combination of v,, v}, and v, because 


vi =v, + 2v3 — V4 
0o 2 =l 3 =2 Q 
— + — 
ko atda ali al 
2 p i 
2 HF | 
In Example 1, it is relatively easy to verify that one of the vectors in the set S is 


a linear combination of the other vectors because the coefficients to form the linear 
combination are given. Example 2 demonstrates a procedure for finding the coefficients. 
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Vector Spaces 


: EXAMPLE 2 | Finding a Linear Combination 


Write the vector w = (1, 1, 1) as a linear combination of vectors in the set 
vy Yz V3 


S = {(1, 2, 3), (0, 1, 2), (— 1, 0, 1)}. 
SOLUTION 
Find scalars c}, c,, and c} such that 
(0,1, =c (1,2,3) 0s 1,2) + c= 1,0,1) 
= (c1, 2c1, 3c1) + (0, cz, 2c5) + (— c3, 0, c3) 
= (ci = ty 2c] + c, 3c) + 2c, + c). 
Equating corresponding components yields the system of linear equations below. 
c =c¢=1 
2c, + G =1 
3c, + 2c, +c, = 1 
Using Gauss-Jordan elimination, the augmented matrix of this system row reduces to 


1 0 -1 1 
0 1 2 =). 
0 0 0 0 


So, this system has infinitely many solutions, each of the form 


cq =1t+t c= -1-2t, c, =t. 
To obtain one solution, you could let £ = 1. Then c} = 1, c, = —3, and c} = 2, and 
you have 


w = 2v, — 3v, + V3. 


(Verify this.) Other choices for t would yield different ways to write w as a linear 
combination of v,, V», and v3. | 


EXAMPLE 3 Finding a Linear Combination 


If possible, write the vector 


w = (1, —2, 2) 


as a linear combination of vectors in the set § in Example 2. 


SOLUTION 


Following the procedure from Example 2 results in the system 


ĉi -c&= 1 


2¢, + C5 = —2 
3c, tntg 2 


The augmented matrix of this system row reduces to 


1 0 =] 0 
0 1 2 0}. 
0 0 0 1 


From the third row you can conclude that the system of equations is inconsistent, 
which means that there is no solution. Consequently, w cannot be written as a linear 
combination of v,, V», and v}. | 
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REMARK 


The coefficient matrix of the 
system in Example 3, 


1 0 -1 
2 1 0 
3 2 1 


has a determinant of zero. 
(Verify this.) 
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SPANNING SETS 


If every vector in a vector space can be written as a linear combination of vectors in a 
set S, then S is a spanning set of the vector space. 


Definition of a Spanning Set of a Vector Space 


Let S = {v), V». 


., V,} be a subset of a vector space V. The set S is a spanning 
set of V when every vector in V can be written as a linear combination of vectors 
in S. In such cases it is said that S spans V. 


EXAMPLE 4 Examples of Spanning Sets 


a. The set S = {(1, 0, 0), (0, 1, 0), (0, 0, 1)} spans R? because any vector u = (u4, Uy, U3) 
in R? can be written as 


u = u,(1, 0,0) + u,(0, 1,0) + u,(0, 0, 1) = (u;, u, u3). 


b. ThesetS = {1, x, x?}spans P, because any polynomial function p(x) = a + bx + cx? 
in P, can be written as 
p(x) = a(1) + b(x) + cQ?) 
a t+ bx + cx’. m 


The spanning sets in Example 4 are called the standard spanning sets of R? and 
P,, respectively. (You will learn more about standard spanning sets in the next section.) 
In the next example, you will look at a nonstandard spanning set of R°. 


j EXAMPLE 5 A Spanning Set of R°? 


Show that the set S = {(1, 2, 3), (0, 1, 2), (— 2, 0, 1)} spans R°. 
SOLUTION 
Let u = (u, uz, u3) be any vector in R°. Find scalars c,, c), and c} such that 


= c;(1, 2, 3) + c(0, 1,2) + c3(—2, 0, 1) 
(ci = 2e: 26i Gy 30 2G te): 


(uy, Uy, Us) 


This vector equation produces the system 
Cy = 26; = uy, 
2c, + 6 = Uy 
3c, + 2c, + cz = Uy. 
The coefficient matrix of this system has a nonzero determinant (verify that it is 
equal to — 1), and it follows from the list of equivalent conditions in Section 3.3 that 


the system has a unique solution. So, any vector in R? can be written as a linear 
combination of the vectors in S, and you can conclude that the set S spans R°. | 


SON SESE A Set That Does Not Span R? 


From Example 3 you know that the set 
S = {05 2, 3), (0, 1, 2), (~ 1, 0, 1)} 


does not span R? because w = (1, — 2, 2) is in R? and cannot be expressed as a linear 
combination of the vectors in S. 
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Sı = {(1, 2, 3), (0, 1, 2), (2, 0, 1)} 
The vectors in S4 do not lie 
in a common plane. 


S2 = {(1, 2, 3), (0, 1, 2), (-1, 0, 1)} 
The vectors in S> lie in a 
common plane. 


Figure 4.14 


Comparing the sets of vectors in Examples 5 and 6, note that the sets are the same 
except for a seemingly insignificant difference in the third vector. 


S, = {(1, 2, 3), (0, 1, 2), (—2, 0, 1)} Example 5 
S, = 4,23), (0) 1,2) (=1,:0, 1)} Example 6 


The difference, however, is significant, because the set S, spans R? whereas the set S, 
does not. The reason for this difference can be seen in Figure 4.14. The vectors in S, lie 
in a common plane; the vectors in S, do not. 

Although the set S, does not span all of R°, it does span a subspace of R?— 
namely, the plane in which the three vectors of S, lie. This subspace is the span of S,, 
as stated in the next definition. 


Definition of the Span of a Set 


If S = {v,, Va}. . ., V,} is a set of vectors in a vector space V, then the span of S 
is the set of all linear combinations of the vectors in S, 


span(S) = {c V] + CVa +> + + + CM: Cis C3,- - «, Cp are real numbers}. 


The span of $ is denoted by 
span(S) or span{v,,V>,. . ., Vg- 


When span(S) = V, it is said that V is spanned by {v,,v>,. . ., V,}, or that 
S spans V. 


The next theorem tells you that the span of any finite nonempty subset of a vector 
space V is a subspace of V. 


THEOREM 4.7 Span(S) Is a Subspace of V 


If S = {v,, Va}. . -, V;,} is a set of vectors in a vector space V, then span(S) is a 


subspace of V. Moreover, span(S) is the smallest subspace of V that contains S, 
in the sense that every other subspace of V that contains S must contain span(S). 


PROOF 


To show that span(S), the set of all linear combinations of v,, Va, . . . , Vj, is a subspace 
of V, show that it is closed under addition and scalar multiplication. Consider any two 
vectors u and v in span(S), 


= CV, + CVV To + OM 
ved, + dv. t+: ++ dy, 
where 
Cis Css e va Cg and d,,d,...,d, 


are scalars. Then 

u +v = (c, + divi + (.+4a)v,+---+(c, + 4,)v, 
and 

cu = (cc,)v, + (cc,)v, ++ + + + (ccp) v 


which means that u + v and cu are also in span(S) because they can be written as 
linear combinations of vectors in S. So, span(S) is a subspace of V. It is left to you to 
prove that span(S) is the smallest subspace of V that contains S. (See Exercise 59.) 
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LINEAR DEPENDENCE AND LINEAR INDEPENDENCE 


For a set of vectors 
S = {vi, Vo... «> Wt 
in a vector space V, the vector equation 
CV, + OV, +++ + +eVv,=90 
always has the trivial solution 
ci = 0,c, =0,...,cq,= 0. 


Sometimes, however, there are also nontrivial solutions. For instance, in Example 1(a) 
you saw that in the set 


vi Me V3 
S = {(1, 3, 1), (0, 1, 2), (1, 0, —5)} 


the vector v, can be written as a linear combination of the other two vectors, as shown 
below. 


v = 3v,+ v 

So, the vector equation 
CV, + GV, + cy = 0 

has a nontrivial solution in which the coefficients are not all zero: 
cq =1, «og =-3, & =-1. 


When a nontrivial solution exists, the set S is linearly dependent. Had the only 
solution been the trivial one (c) = c, = c} = 0), then the set S would have been 
linearly independent. This concept is essential to the study of linear algebra. 


Definition of Linear Dependence and Linear Independence 


A set of vectors $ = {v,, V,- . ., V,} ina vector space V is linearly independent 
when the vector equation 


CV, t+ OV, +: +: +e¢Vv,=90 
has only the trivial solution 
ci = 0,c, =0,...,¢q= 0. 


If there are also nontrivial solutions, then S is linearly dependent. 


EXAMPLE 7 Examples of Linearly Dependent Sets 


a. The set S = {(1, 2), (2, 4)} in R? is linearly dependent because 
—2(1, 2) + (2, 4) = (0, 0). 
b. The set S$ = {(1, 0), (0, 1), (—2, 5)} in R? is linearly dependent because 
2(1, 0) — 5(0, 1) + (—2, 5) = (0, 0). 
c. The set S = {(0, 0), (1, 2)} in R? is linearly dependent because 
1(0, 0) + 0(1, 2) = (0, 0). La 


The next example demonstrates a test to determine whether a set of vectors is 
linearly independent or linearly dependent. 
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EXAMPLE 8 Testing for Linear Independence 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


Determine whether the set of vectors in R? is linearly independent or linearly dependent. 
S = {v,, Vo, v3} = {(1, 2, 3), (0, 1, 2), (—2, 0, 1)} 

SOLUTION 

To test for linear independence or linear dependence, form the vector equation 
CV, + CoV, + cy = 0. 


If the only solution of this equation is c} = cy = c} = 0, then the set S is linearly 
independent. Otherwise, S is linearly dependent. Expanding this equation, you have 


¢,(1, 2, 3) + €5(0, 1, 2) + ¢,(—2, 0, 1) = (0, 0, 0) 
(ci — 2c3, 2c, + cp, 3c, + 2c, + c3) = (0, 0, 0) 


which yields the homogeneous system of linear equations in c}, c», and c} below. 


2c, + cy = 
3c, + 2c, + c, =0 


The augmented matrix of this system reduces by Gauss-Jordan elimination as shown. 


1 0 -2 0 1 0 0 0 
2 1 0 o| => jo 1 0 0 
3 2 1 0 0 0 1 0 


This implies that the only solution is the trivial solution c} = c, = c} = 0. So, S is 
linearly independent. | 


The steps in Example 8 are summarized below. 


Testing for Linear Independence and Linear Dependence 


Let S = {v,,¥5,. . ., V,} be a set of vectors in a vector space V. To determine 
whether S is linearly independent or linearly dependent, use the steps below. 


. From the vector equation c,v, + c,v, +: + © + cv, = 0, write a system of 
linear equations in the variables c,,c5,. . ., and cy. 

. Determine whether the system has a unique solution. 

. If the system has only the trivial solution, c} = 0,c, = 0,. . .,c, = 0, 
then the set S is linearly independent. If the system also has nontrivial 
solutions, then S is linearly dependent. 


LINEAR Image morphing is the process of transforming one 
ALGEBRA image into another by generating a sequence of synthetic 

intermediate images. Morphing has a wide variety of 
APPLIED applications, such as movie special effects, age progression 
software, and simulating wound healing and cosmetic surgery 
results. Morphing an image uses a process called warping, 
in which a piece of an image is distorted. The mathematics 
behind warping and morphing can include forming a linear 
combination of the vectors that bound a triangular piece of 
an image, and performing an affine transformation to form 
new vectors and a distorted image piece. 


dundanim/Shutterstock.com 
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EXAMPLE 9 Testing for Linear Independence 


Determine whether the set of vectors in P, is linearly independent or linearly dependent. 


vi v v3 
S = {1 +x — 2x, 2 + 5x — x, x + x7} 
SOLUTION 
Expanding the equation c,;v, + c,V, + c3V3 = 0 produces 
a(l + x — 2x?) + c,(2 + 5x — x?) + cx + x?) = 0 + Ox + Ox? 
(ci + 203) + (ci Sey Hee (= 26, =i + Ge = 0 + Oe + Or, 


Equating corresponding coefficients of powers of x yields the homogeneous system of 
linear equations in c}, C3, and c; below. 


Gi t 265 =0 
ci + 5c, +c, =0 
—2c, ataO 


The augmented matrix of this system reduces by Gaussian elimination as shown below. 


1 2 0 0 i 2 0 0 
1 5 1 o| æ> Jo 1 | o 
-2 -1 1 0 0 0 0 0 


This implies that the system has infinitely many solutions. So, the system must have 
nontrivial solutions, and you can conclude that the set S is linearly dependent. 
One nontrivial solution is 


ġ=2 &=-1l, and &=3 
which yields the nontrivial linear combination 


DU +x- 22) + (12 + 5x- 2) + Ge) = O0. ul 


DOA Testing for Linear Independence 


Determine whether the set of vectors in M, , is linearly independent or linearly dependent. 


vi Vo V3 


|) abe ol 


SOLUTION 


From the equation cV; + CV, + c3V3 = 0, you have 


2 1 3 0 1 0 0 0 
alo ilaa: tel o) = lo j 


which produces the system of linear equations in c}, c,, and c} below. 


26i + 3c, + c,=0 


Use Gaussian elimination to show that the system has only the trivial solution, which 
means that the set S is linearly independent. | 
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EXAMPLE 11 Testing for Linear Independence 


Determine whether the set of vectors in M, , is linearly independent or linearly dependent. 


1) }1 0 0 
oj | 1 3 1 
S = {v Vo, V3, va} = =j 5 0 ’ 1 $ =j 
0j |2| |72 2 
SOLUTION 
From the equation c,v, + C V, + €3V3 + c,V, = 0, you obtain 
1 1 0 0 0 
0 1 3 1 0 
Cy | TS i117 “_1}=lol 
0 2 =2 2 0 


This equation produces the system of linear equations in c}, C2, C3, and c4 below. 


ĉit G5 =0 
cy + 3c, + cy = 0 
=c + ¢3—- C,=0 


2¢, — 2c, + 2c, = 0 


Use Gaussian elimination to show that the system has only the trivial solution, which 
means that the set S is linearly independent. | 


If a set of vectors is linearly dependent, then by definition the equation 
CV, + CVa ++ + + + CV = 0 has a nontrivial solution (a solution for which not all 
the c;’s are zero). For instance, if c, # 0, then you can solve this equation for v, and 
write v, as a linear combination of the other vectors v,, V}, . . . , and v,. In other words, 
the vector v, depends on the other vectors in the set. This property is characteristic of 
a linearly dependent set. 


THEOREM 4.8 A Property of Linearly Dependent Sets 


A set S = {v Vinee eg V}, k = 2, is linearly dependent if and only if at least one 
of the vectors v, can be written as a linear combination of the other vectors in S. 


PROOF 


To prove the theorem in one direction, assume S is a linearly dependent set. Then there 
exist scalars C,,C,,C3,. . . , Cp (not all zero) such that 


CV, + CN + CW +--+ +> + Vv, = 0. 


One of the coefficients must be nonzero, so no generality is lost by assuming c, # 0. 
Then solving for v, as a linear combination of the other vectors produces 


CV, = —Cg¥_ — C3V, — °° + — GY, 
c C c 

Mi Žv, *y, Ev, 
cy Cy ci 


Conversely, assume the vector v, in S is a linear combination of the other vectors. That is, 


Vi = CVa + CV H> + + + CY. 
Then the equation — v; + c,v, + c,¥, ++: > + + CV = 0 has at least one coefficient, 
— 1, that is nonzero, and you can conclude that S is linearly dependent. | 
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REMARK 


The zero vector is always 
a scalar multiple of another 
vector in a vector space. 
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=e Writing a Vector as a Linear 
EXAMPLE 12 Combination of Other Vectors 


In Example 9, you determined that the set 


vi V2 V3 
S={1+x- 2x°,2+ 5x -—2x?,x + x7} 


is linearly dependent. Show that one of the vectors in this set can be written as a linear 
combination of the other two. 


SOLUTION 
In Example 9, the equation c,v, + c,v, + c3;¥; = 0 produced the system 
ci + 2c =0 


ĉi + 5c + ¢, = 0 
=2¢; = zt c= 0. 


This system has infinitely many solutions represented by c, = 3t, c, = —t, and 
c, = 2t. Letting t = 1 results in the equation 2v; — v, + 3v, = 0. So, v, can be 
written as a linear combination of v, and v,, as shown below. 


v, = 2v, + 3v, 

A check yields 
2 + 5x — x2 = (1 +x — 2x2) + 3(x + 2) = 2 + 5x- x. | 
Theorem 4.8 has a practical corollary that provides a simple test for determining 


whether two vectors are linearly dependent. In Exercise 77 you are asked to prove this 
corollary. 


THEOREM 4.8 Corollary 


Two vectors u and v in a vector space V are linearly dependent if and only if one 
is a scalar multiple of the other. 


DATTE Testing for Linear Dependence of Two Vectors 


a. The set S = {v,, v2} = {(1, 2, 0), (—2, 2, 1)} is linearly independent because v, and 
v, are not scalar multiples of each other, as shown in Figure 4.15(a). 


b. The set $ = {v,, v,} = {(4, —4, — 2), (—2, 2, 1)} is linearly dependent because 
v; = —2v,, as shown in Figure 4.15(b). 


a. z b. ; 
3 64 
2a 4A 
S= {(1, 2, 0), (-2, 2, 1)} S= {(4, —4, —2), (—2, 2, 1)} 
The set S is linearly independent. The set S is linearly dependent. 
Figure 4.15 m 
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4.4 Exercises 


Linear Combinations In Exercises 1-4, write each 
vector as a linear combination of the vectors in S (if 
possible). 
1. S = {(2, — 1, 3), (5, 0, 4)} 
(a) z = (—1, —2, 2) 
(c) w = (1, —8, 12) 
2. S = {(1, 2, — 2), (2, — 1, 1)} 
(a) z = (—4, —3, 3) (b) v = (—2, —6, 6) 
(c) w = (—1, —22, 22) (d) u = (1, —5, —5) 
3. S = {(2, 0, 7), (2, 4, 5), (2, — 12, 13)} 
(a) u = (-1,5, —6) (b) v = (—3, 15, 18) 
© w= (3,3,3) (d) z = (2, 20, —3) 
4. S = {(6, —7, 8, 6), (4, 6, — 4, 1)} 
(a) u = (2, 19, —16,—4) b) v= (, 2 -14, 8) 
(c) w = (—4, —14,2, 3) @ z = (8,4, — 1, 4) 


(b) v = (8, -4 7) 
(d) u = (I; T; -1) 


Linear Combinations In Exercises 5-8, for the matrices 


2 -3 0 5 
azi; H and B=|? S| 


in M,,, determine whether the given matrix is a linear 
combination of A and B. 


6 —19 
5: 
Fue 
=2. 223 
7. 
[o 5] 
Spanning Sets In Exercises 9—18, determine whether 


the set S spans R?. If the set does not span R?, then give 
a geometric description of the subspace that it does span. 


9. S = {(2, 1), (—1, 2)} 10. S = {(—1, 1), (3, 1} 
11. S = {(5, 0), (5, —4)} 12. S = {(2, 0), (0, 1)} 
13. S = {(—3,5)} 14. S = {(1, 1)} 


See CalcChat.com for worked-out solutions to odd-numbered exercises. 


oy sre) 
I 
me [E], 
25. Determine whether the set S = {1, x?, 2 + x?} spans P,. 
26. Determine whether the set 
S = {-2x + x2, 8 + x3, —x?2 + 33, -4 + x7} 
spans P}. 
Testing for Linear Independence In Exercises 27-40, 


determine whether the set S is linearly independent or 
linearly dependent. 


27. 
29, 
30. 
31. 
32. 
33. 
34. 
35. 
36. 
37. 
38. 
39. 
40. 


S = {(-2, 2), 3, 5)} 
s = {(0, 0), (1, —1)} 
S = {(1, 0), (1, 1), 2, —1)} 

S= {(, —4, 1), (6, 3, 2)} 

S = {(6, 2, 1), (— 1, 3, 2)} 

S = {(-2, 1, 3), (2, 9, — 3), (2, 3, —3)} 

S= {(, l; 1), (2; 2: 2) (3, 3, 3)} 

S = {(3, 3,3), (3, 4,3), (-3, 6 2)} 

S = {(-4, —3, 4), (1, — 2, 3), (6, 0, 0)} 

S = {(1, 0, 0), (0, 4, 0), (0, 0, — 6), (1, 5, —3)} 

S = {(4, —3, 6, 2), (1, 8, 3, 1), (3, —2, — 1, 0)} 

S= {(0, 0, 0, 1), (0, 0, 1, 1), (0, 1, 1, 1), (1, 1, 1, 1)} 
S= {(4, 1,2, 3), (3, 2, 1, 4), (1, 5,5, 9), (1, 3,9, 7)} 


28. S = {(3, —6), (—1, 2)} 


Testing for Linear Independence In Exercises 41-48, 
determine whether the set of vectors in P, is linearly 
independent or linearly dependent. 


41. 
42. 
43. 
44. 
45. 
46. 
47. 


S = {2 — x, 2x — x, 6 — 5x + x} 

S =]{-1 + x, 5 + 2x} 

S = {1 + 3x 4+ x7, —1 +x + 2x, 4x} 

S = {x?2,1 + x} 
S={-x+x7,-5 +x, -5+ x7} 

S =]{-2 — x, 2 + 3x + x2, 6 + 5x + x?} 

S = {7 — 3x + 4x2, 6 + 2x — x, 1 — 8x + 5x} 


15. 
17. 
18. 


S = {(-1, 2), (2, —4)} 16. 5 = {(0, 2), (1, 4)} 
S = {(1, 3), (—2, — 6), (4, 12)} 
S = {(-1, 2), (2, = 1), (1, D} 


Spanning Sets In Exercises 19-24, determine whether 
the set S spans R°. If the set does not span R?, then give 
a geometric description of the subspace that it does span. 


19. 
20. 
21. 
22. 
23. 
24. 


S = {(4,7, 3), (—1, 2, 6), (2, —3, 5)} 

S = {(5, 6, 5), (2, 1, — 5), (0, —4, 1)} 

S = {(—2, 5, 0), (4, 6, 3)} 

S = {(1, 0, 1), (1, 1, 0), (0, 1, 1)} 

S = {(1, —2, 0), (0, 0, 1), (— 1, 2, 0)} 

S = {(1, 0, 3), (2, 0, — 1), (4, 0, 5), (2, 0, 6)} 


48. S = {7 — 4x + 4x2, 6 + 2x — 3x2, 20 — 6x + 5x?} 


Testing for Linear Independence In Exercises 49-52, 
determine whether the set of vectors in M,, is linearly 
independent or linearly dependent. 


1 0 0 1 =o f 
aah ali oE 1 
1 0 0 1 0 O 
0 da 7 È ale- f o] 


| 
51. aa ~le- oF a 
=| i 


50. A = 
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Showing Linear Dependence In Exercises 53-56, 
show that the set is linearly dependent by finding a 
nontrivial linear combination of vectors in the set whose 
sum is the zero vector. Then express one of the vectors 
in the set as a linear combination of the other vectors in 
the set. 


53. S = {(3, 4), (1, 1), (2, 0)} 

54. S = {(2, 4), (—1, —2), 0, 6)} 

55. S = {(1, 1, 1), (1, 1,0), (0, 1, 1), (0, 0, 1)} 
56. S = {(1, 2, 3, 4), (1, 0, 1, 2), (1, 4, 5, 6)} 


57. For which values of t is each set linearly independent? 
(a) S = {(t, 1, 1), (1, £, 1), (1, 1,9} 
(b) S = {(¢, 1, 1), (1, 0, 1), (1, 1, 34)} 

58. For which values of ¢ is each set linearly independent? 
(a) S = {(t, 0, 0), (0, 1, 0), (0, 0, 1)} 
(b) S = {(t, t, £), (t, 1, 0), (t, 0, 1)} 

59. Proof Complete the proof of Theorem 4.7. 


60. CAPSTONE By inspection, determine why 
each of the sets is linearly dependent. 


(a) S = {(1, —2), (2, 3), (—2, 4)} 


b) S = {(1, —6, 2), (2, — 12, 4)} 
(c) S = {(0, 0), (1, 0)} 


Spanning the Same Subspace In Exercises 61 and 62, 
show that the sets S; and S, span the same subspace of R°. 


61. S, = {(1,2, —1), (0, 1, 1), (2, 5, —1)} 
S, = {(—2, —6, 0), (1, 1, —2)} 

62. S, = {(0, 0, 1), (0, 1, 1), (2, 1, 1)} 
S, = {(1, 1, 1), (1, 1, 2), (2, 1, 1)} 


True or False? In Exercises 63 and 64, determine 
whether each statement is true or false. If a statement 
is true, give a reason or cite an appropriate statement 
from the text. If a statement is false, provide an example 
that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


63. (a) A set of vectors S = {V}, V». . ., V,} in a vector 

space is linearly dependent when the vector equation 

CV, + OV, ++ + + + oY, = 0 has only the trivial 

solution. 

The set S = {(1, 0, 0, 0), (0, — 1, 0, 0), (0, 0, 1, 0), 

(0, 0, 0, 1)} spans R4. 

64. (a) A set S={v,,v5,...,V,}, k = 2, is linearly 
independent if and only if at least one of the 
vectors v; can be written as a linear combination of 
the other vectors in S. 


(b 


mS 


(b) If a subset S spans a vector space V, then every 
vector in V can be written as a linear combination 
of the vectors in S. 
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Proof In Exercises 65 and 66, prove that the set of 
vectors is linearly independent and spans R°. 


65. B = {(1, 1, 1), (1, 1, 0), (1, 0, 0)} 
66. B = {(1, 2, 3), (3, 2, 1), (0, 0, 1)} 


67. Guided Proof Prove that a nonempty subset of a 
finite set of linearly independent vectors is linearly 
independent. 


Getting Started: You need to show that a subset of a 
linearly independent set of vectors cannot be linearly 
dependent. 


(i) Assume S is a set of linearly independent vectors. 
Let T be a subset of S. 


(ii) If T is linearly dependent, then there exist constants 
not all zero satisfying the vector equation 
CV, + OV, tee tew =D. 

(iii) Use this fact to derive a contradiction and conclude 
that T is linearly independent. 


68. Proof Prove that if S} is a nonempty subset of the 
finite set S,, and S, is linearly dependent, then so is S,. 


69. Proof Prove that any set of vectors containing the 
zero vector is linearly dependent. 


70. Proof When the set of vectors {u,,u,,...,u,} is 
linearly independent and the set {u,,u,,. . .,U,, V} is 
linearly dependent, prove that v is a linear combination 
of the u,’s. 


71. Proof Let {v,,v5,. . ., V,} be a linearly independent 
set of vectors in a vector space V. Delete the vector v, 


from this set and prove that the set {v}, V5,. . -,V,—1} 
cannot span V. 
72. Proof When V is spanned by {v,,v>,...-,V,} 


and one of these vectors can be written as a linear 
combination of the other k — 1 vectors, prove that the 
span of these k — 1 vectors is also V. 


73. Proof Let S = {u, v} be a linearly independent set. 
Prove that the set {u + v, u — v}is linearly independent. 


74. Let u,v, and w be any three vectors from a vector 
space V. Determine whether the set of vectors 
{v —u,w-—v,u— w} is linearly independent or 
linearly dependent. 

75. Proof Let A be a nonsingular matrix of order 3. Prove 
that if {v,, Və, V3} is a linearly independent set in M3, 
then the set {Av,, Av, Av;} is also linearly independent. 
Explain, by means of an example, why this is not true 
when A is singular. 

76. Let f,(x) = 3x and f(x) = |x|. Graph both functions 
on the interval —2 < x < 2. Show that these functions 
are linearly dependent in the vector space C[0, 1], but 
linearly independent in C[—1, 1]. 

77. Proof Prove the corollary to Theorem 4.8: Two 
vectors u and v are linearly dependent if and only if one 
is a scalar multiple of the other. 
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4.5 Basis and Dimension 


REMARK 


This definition tells you that 

a basis has two features. 

A basis S must have enough 
vectors to span V, but not so 
many vectors that one of them 
could be written as a linear 
combination of the other 
vectors in S. 


Figure 4.16 


Ws Recognize bases in the vector spaces R”, P,, and M,,, n 
Į Find the dimension of a vector space. 


BASIS FOR A VECTOR SPACE 


In this section, you will continue your study of spanning sets. In particular, you will 
look at spanning sets in a vector space that are both linearly independent and span the 
entire space. Such a set forms a basis for the vector space. (The plural of basis is bases.) 


Definition of Basis 


A set of vectors S = {V}, Va}. . ., V,} in a vector space V is a basis for V when 
the conditions below are true. 


1. S spans V. 2. S is linearly independent. 


This definition does not imply that every vector space has a basis consisting of 
a finite number of vectors. This text, however, restricts the discussion to such bases. 
Moreover, if a vector space V has a basis with a finite number of vectors, then V is 
finite dimensional. Otherwise, V is infinite dimensional. [The vector space P of all 
polynomials is infinite dimensional, as is the vector space C(— 00, co) of all continuous 
functions defined on the real line.] The vector space V = {0}, consisting of the zero 
vector alone, is finite dimensional. 


EXAMPLE 1 The Standard Basis for R? 


Show that the set below is a basis for R?. 
S = {(1, 0, 0), (0, 1, 0), (0, 0, 1)} 
SOLUTION 


Example 4(a) in Section 4.4 showed that S spans R°. Furthermore, S is linearly 
independent because the vector equation 


c,(1, 0, 0) + c,(0, 1, 0) + c,(0, 0, 1) = (0, 0, 0) 
has only the trivial solution 
Ci = C, =e, = 0. 


(Verify this.) So, S is a basis for R?. (See Figure 4.16.) | 


The basis 
S = {(1, 0, 0), (0, 1, 0), (O, O, 1)} 
is the standard basis for R*. This can be generalized to n-space. That is, the vectors 


e, = (1,0,. . .,0) 
e = (0,1,. . ., 0) 


e, = (0,0,.. ., 1) 


form the standard basis for R”. 
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The next two examples describe nonstandard bases for R? and R°. 


EXAMPLE 2 A Nonstandard Basis for R? 


Show that the set 


vi vV, 
S = {(1, 1), (1, - 1} 
is a basis for R?. 


SOLUTION 


According to the definition of a basis for a vector space, you must show that S spans 
R? and S is linearly independent. 
To verify that S spans R?, let 


x = (x,, x) 


represent an arbitrary vector in R?. To show that x can be written as a linear combination 
of v, and v,, consider the equation 


CV, + CoV, =X 
c,(, 1) + 6 (1, —1) = (x, x) 
(ci + enc — o) = Bp x). 

Equating corresponding components yields the system of linear equations below. 

Gi T Ca = xy 

1 GTM 
The coefficient matrix of this system has a nonzero determinant, which means that the 
system has a unique solution. So, S spans R?. 


One way to show that S is linearly independent is to let (x, x2) = (0, 0) in the 
above system, yielding the homogeneous system 


c, tc, =0 
ce; — ¢, = 0. 

This system has only the trivial solution 
cp =o, = 0. 


So, S is linearly independent. An alternative way to show that S is linearly independent 
is to note that 


v,=(1,1) and v, = (1, -1) 


are not scalar multiples of each other. This means, by the corollary to Theorem 4.8, that 
S = {v,, V3} is linearly independent. 

You can conclude that S is a basis for R? because it is a spanning set for R? and it 
is linearly independent. | 


‘EXAMPLE 3 A Nonstandard Basis for R? 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


From Examples 5 and 8 in the preceding section, you know that 
S = {(1, 2, 3), (0, 1, 2), (—2, 0; 1)} 


spans R? and is linearly independent. So, S is a basis for R°. m 
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REMARK 


The basis S = {1, x, x2, x3} 
is the standard basis for P}. 
Similarly, the standard basis 
for P,, is 


SH 41, XX a op OY 


EXAM PLE 4 A Basis for Polynomials 


Show that the vector space P, has the basis 
S = {1, x, x7, 2°}. 

SOLUTION 

It is clear that S spans P because the span of S consists of all polynomials of the form 
dy + ax + ax? + a3X?, do, A}, A>, and a, are real numbers 


which is precisely the form of all polynomials in P}. 
To verify the linear independence of S, recall that the zero vector 0 in P} is the 
polynomial 0(x) = 0 for all x. The test for linear independence yields the equation 


dy + ax + ax? + a,x? = O(x) = 0, forall x. 


This third-degree polynomial is identically equal to zero. From algebra you know that 
for a polynomial to be identically equal to zero, all of its coefficients must be zero; 
that is, 


dy = a, = a, =a, = 0. 


So, S is linearly independent and is a basis for P}. | 
EXAMPLE5 A Basis for M,, 
The set 


EIB IC IG 


is a basis for M,,. This set is the standard basis for M, ,. In a similar manner, the 
standard basis for the vector space M„,„ consists of the mn distinct m x n matrices 


m,n 


having a single entry equal to 1 and all the other entries equal to 0. | 


THEOREM 4.9 Uniqueness of Basis Representation 


If S = {v,, v>,. . ., V„} is a basis for a vector space V, then every vector in V 
can be written in one and only one way as a linear combination of vectors in S. 


PROOF 
The existence portion of the proof is straightforward. That is, S spans V, so you know 
that an arbitrary vector u in V can be expressed as u = c,V, + CVa ++ coe + Cpp 


To prove uniqueness (that a vector can be represented in only one way), assume u 
has another representation 


u = bv, + bv, ++ > + + By,. 
Subtracting the second representation from the first produces 
u—u=(c, — b,)v, + (co — by)vo +--+ + + (c, — b,)v, = 0. 


S is linearly independent, however, so the only solution to this equation is the trivial 
solution 


c, —b, =0, co -—b,=0, ..., ¢,-—b,=0 
which means that c, = b, for alli = 1,2,. . ., n, and u has only one representation for 
the basis S. 
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EXAMPLE 6 Uniqueness of Basis Representation 


Letu = {u}, Uy, Us} be any vector in R?. Show that the equation u = c,v, + c,V, + C3V3 
has a unique solution for the basis S = {v,, v,, v3} = {(1, 2, 3), (0, 1, 2), (—2, 0, 1)}. 


SOLUTION 


From the equation 


(uy, Us, U3) = c(l, 2, 3) + c,(0, 1, 2) + c3(—2, 0, 1) 
(C= 26, 26, Eese F 2G, +c) 


you obtain the system of linear equations below. 


Cy = 263 = üj 1 0 =2 c uy 
26; + Co = Uy 2 1 0 || ce | = | u 
3c, + 2c, + C3 =U, 3 2 1 |hc3 uz 
A c u 
The matrix A is invertible, so you know this system has a unique solution, e = A™'u. 
Verify by finding A~! that 
ci = —u, + 4u, — 2u 
Cy = 2u — Tu, + 4u, 
C3 = =u + 2u, — Us. 
For example, u = (1, 0, 0) can be represented uniquely as —v, + 2v, — v3. T 


You will now study two important theorems concerning bases. 


THEOREM 4.10 Bases and Linear Dependence 


If S = {v Vie e w Va is a basis for a vector space V, then every set containing 
more than n vectors in V is linearly dependent. 


PROOF 

Let S, = {u,,u,,. . .,u,,} be any set of m vectors in V, where m > n. To show that 

S, is linearly dependent, you need to find scalars k,, k», . . . , k„ (not all zero) such that 
ku, + ku, +: -o+ k,n = 0. Equation 1 


S is a basis for V, so each u, can be represented as a linear combination of vectors in S: 


Uy = CVa E CVa Fo + CY, 
Uy = CyoVy P CVa t+ + + CV, 
u,, E CimV1 + ComV2 arses CamYw 


Substituting into Equation 1 and regrouping terms produces 
dyi +t dy, +t: -+d Ny, =0 


where d; = Caki + Cika + + © + + CimKm The v; s form a linearly independent set, so 


im ~“m-* 


each d, = 0, and you obtain the system of equations below. 


Ck, tipka +++ + + €4,,k,, = 0 
Cok + Cook, ++ + + + ey, kK, = 0 
Caki + Cyoky + E Caka = 9 
But this homogeneous system has fewer equations than variables k,, k,,. . .,k,,, and 


from Theorem 1.1, it has nontrivial solutions. Consequently, S, is linearly dependent. | 
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EXAMPLE 7 Linearly Dependent Sets in R? and P} 


a. R? has a basis consisting of three vectors, so the set 
S = {(1, 2, — 1), (1, 1, 0), (2, 3, 0), (5, 9, —1)} 


must be linearly dependent. 


b. P, has a basis consisting of four vectors, so the set 
S={l,lt+x,l1—x,1+x+3%7,1-—x+ x*} 
must be linearly dependent. | 
R” has the standard basis consisting of n vectors, so it follows from Theorem 4.10 


that every set of vectors in R” containing more than n vectors must be linearly dependent. 
The next theorem states another significant consequence of Theorem 4.10. 


THEOREM 4.11 Number of Vectors in a Basis 


If a vector space V has one basis with n vectors, then every basis for V has 
n vectors. 


PROOF 


Let S, = {v,,V),. . ., V„} be a basis for V, and let S, = {u}, u,,. . ., u,,} be any other 
basis for V. Theorem 4.10 implies that m = n, because S} is a basis and S, is linearly 
independent. Similarly, n S m because S, is linearly independent and S, is a basis. 
Consequently, n = m. | 


EXAMPLE 8 Spanning Sets and Bases 


Use Theorem 4.11 to explain why each statement is true. 


a. The set S, = {(3, 2, 1), (7, — 1, 4)} is not a basis for R°. 
b. The set $, = {2 + x, x7, —1 + x9, 1 + 3x, 3 — 2x + x7} is not a basis for P}. 


SOLUTION 


a. The standard basis for R?, S = {(1, 0, 0), (0, 1, 0), (0, 0, 1)}, has three vectors, and 
S; has only two vectors. By Theorem 4.11, S, cannot be a basis for R°. 


b. The standard basis for P}, S = {1, x, x”, x3}, has four vectors. By Theorem 4.11, the 
set S, has too many vectors to be a basis for P}. 


LINEAR The RGB color model uses combinations of red (r), green 
ALGEBRA (g), and blue (b), known as the primary additive colors, to 

create all other colors in a system. Using the standard basis 
APPLIED for R?, where r = (1, 0, 0), g = (0, 1, 0), and b = (0, 0, 1), 
any visible color can be represented as a linear 
combination cr + cg + cb of the primary additive colors. 
The coefficients c; are values between 0 and a specified 
maximum a, inclusive. When c, = c, = C, the color is 
grayscale, with c; = 0 representing black and c; = a 
representing white. The RGB color model is commonly 
used in computers, smart phones, televisions, and other 
electronics with a color display. 


Chernetskiy/Shutterstock.com 
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THE DIMENSION OF A VECTOR SPACE 


By Theorem 4.11, if a vector space V has a basis consisting of n vectors, then every 
other basis for the space also has n vectors. This number n is the dimension of V. 


Definition of the Dimension of a Vector Space 


If a vector space V has a basis consisting of n vectors, then the number n is the 
dimension of V, denoted by dim(V) = n. When V consists of the zero vector 
alone, the dimension of V is defined as zero. 


This definition allows you to state the dimensions of familiar vector spaces. In each 
example listed below, the dimension is simply the number of vectors in the standard 
basis. 


1. The dimension of R” with the standard operations is n. 
2. The dimension of P, with the standard operations is n + 1. 
3. The dimension of M,,,,, with the standard operations is mn. 


If W is a subspace of a vector space V that has dimension n, then it can be shown 
that the dimension of W is less than or equal to n. (See Exercise 83.) The next three 
examples show a technique for finding the dimension of a subspace. Basically, you 
determine the dimension by finding a set of linearly independent vectors that spans the 
subspace. This set is a basis for the subspace, and the dimension of the subspace is the 
number of vectors in the basis. 


EXAM PLE 9 Finding Dimensions of Subspaces 


Find the dimension of each subspace of R°. 


a. W = {(d,c — d, c): c and d are real numbers} 
b. W = {(2b, b, 0): b is a real number} 


SOLUTION 
REMARK a. By writing the representative vector (d, c — d, c) as 


In Example 9(a), the subspace (d, c — d, c) = (0, c, c) + (d, =d, 0) = c(0, 1, 1) + dQ, — 1, 0) 


W is the plane in R? determined you can see that W is spanned by the set S = {(0, 1, 1), (1, — 1, 0)}. Using the 
by the vectors (0, 1, 1) and techniques described in the preceding section, you can show that this set is linearly 


(1, =1, 0). In Example 9(b), the independent. So, S is a basis for W, and W is a two-dimensional subspace of R?. 
subspace is the line determined 


by the vector (2, 1, 0). b. By writing the representative vector (2b, b, 0) as b(2, 1, 0), you can see that W is 
spanned by the set $ = {(2, 1, 0)}. So, W is a one-dimensional subspace of R°. 


EXAMPLE 10 Finding the Dimension of a Subspace 


Find the dimension of the subspace W of R* spanned by 
S = {vi Vo Vat = {(- 1, 2, 5, 0), (3, 0, 1, —2), (—5, 4, 9, 2)}. 


SOLUTION 


Although W is spanned by the set S, S is not a basis for W because S is a linearly 
dependent set. Specifically, v, can be written as v, = 2v, — v5. This means that W is 
spanned by the set S}, = {v,, V2}. Moreover, S, is linearly independent because neither 
vector is a scalar multiple of the other, and you can conclude that the dimension of W 


is 2. | 
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EXAMPLE 11 Finding the Dimension of a Subspace 


Let W be the subspace of all symmetric matrices in M, ,. What is the dimension of W? 


SOLUTION 


Every 2 x 2 symmetric matrix has the form 
a b 1 0 0 1 0 0 
a|; edo alt: tde 1 
So, the set 
slo oli oblo a) 
0 op L1 or Lo 1 


spans W. Moreover, S can be shown to be linearly independent, and you can conclude 
that the dimension of W is 3. 


Usually, to conclude that a set S = {v,, V>,. . ., V,,} is a basis for a vector space 
V, you must show that S satisfies two conditions: § spans V and is linearly independent. 
If V is known to have a dimension of n, however, then the next theorem tells you that 
you do not need to check both conditions. Either one will suffice. The proof is left as 
an exercise. (See Exercise 82.) 


THEOREM 4.12 Basis Tests in an n-Dimensional Space 


Let V be a vector space of dimension n. 


1. If S = {v,, Va. . ., V,,} is a linearly independent set of vectors in V, then S 
is a basis for V. 
2. If S = {v,, V}. . ., V,} spans V, then S is a basis for V. 


DOAIA Testing for a Basis in an n-Dimensional Space 


Show that the set of vectors is a basis for Ms ,. 


vi vV v3 V4 V5 


SOLUTION 


S has five vectors and the dimension of M,;, is 5, so apply Theorem 4.12 to 
verify that S is a basis by showing either that S is linearly independent or that 
S spans M,,. To show that S is linearly independent, form the vector equation 
CV, + CV + €3V3 + C4V, + CV; = 0, which yields the linear system below. 


Cy = 
2¢, + Cy = 
=¢; + 3¢, + 2¢, = 
3c, = 26 = cz + 2cy4 =0 


4c, + 3c, + 5c, — 3c, — 2c; = 0 


This system has only the trivial solution, so S is linearly independent. By Theorem 4.12, 
S is a basis for M5. | 
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Writing the Standard Basis In Exercises 1-6, write 
the standard basis for the vector space. 


1. R6 2. R4 
3. M53 4. M,, 
5. P, 6. P, 


Explaining Why a Set Is Not a Basis In Exercises 7-14, 
explain why S is not a basis for R?. 


7. S = {(—4, 5), (0, 0)} 8. S = {(2, 3), (6, 9)} 
9. S = {(—3, 2)} 10. S = {(5, —7)} 
11. S = {(1, 2), (1, 0), (0, 1)} 
12. S = {(—1, 2), (1, — 2), (2, 4)} 
13. S = {(6, — 5), (12, — 10)} 
14. S = {(4, —3), (8, —6)} 
Explaining Why a Set Is Not a Basis In Exercises 
15-22, explain why S is not a basis for R°. 
15. S = {(1, 3, 0), (4, 1, 2), (—2, 5, —2)} 
16. S = {(2, 1, — 2), (—2, — 1, 2), (4, 2, —4)} 
17. S = {(7, 0, 3), (8, — 4, 1)} 
18. S = {(1, 1, 2), (0, 2, 1)} 
19. S = {(0, 0, 0), (1, 0, 0), (0, 1, 0)} 
20. S = {(— 1, 0, 0), (0, 0, 1), (1, 0, 0)} 
21. S = {(1, 1, 1), (0, 1, 1), (1, 0, 1), (0, 0, 0)} 
22. S = {(6, 4, 1), (3, —5, 1), (8, 13, 6), (0, 6, 9)} 
Explaining Why a Set Is Not a Basis In Exercises 
23-30, explain why S is not a basis for P}. 
23. S = {1, 2x, —4 + x2, 5x} 24. S = {2,x,3 + x, 3x2} 
25. S = {— x, 4x7} 26. S = {-1, 11x} 
27. S = {1 + 2,1 — x} 
28. S = {1 — 2x + x, 3 — 6x + 3x, —2 + 4x — 2x7} 
29. S= {1 —x,1 — xX, —1 — 2x + 3x7} 
30. S = {-3 + 6x, 3x”, 1 — 2x — x7} 


Explaining Why a Set Is Not a Basis In Exercises 
31-34, explain why S is not a basis for M, 2. 


ssf tbl ol 

lo obli al 

msl. oba oblo ahl- 3l 
lo ahi o 


> 


1 0 


Determining Whether a Set Is a Basis In Exercises 
35-38, determine whether the set {v,, v,} is a basis for R?. 


35. 


a J. 
an 38. 4 
2+ 1 
¥2 vi va 
1+ } rx 
V1 -1 1 
} Hr -1 
1 2 


Determining Whether a Set Is a Basis In Exercises 
39-46, determine whether S is a basis for the given 
vector space. 


39. S = {(4, —3), (5, 2)} for R? 

40. S = {(1, 2), (1, —1)} for R? 

41. S = {(1, 5, 3), (0, 1, 2), (0, 0, 6)} for R? 

42, S = {(2, 1,0), (0, — 1, 1)} for R3 

43. S = {(0, 3, —2), (4, 0, 3), (—8, 15, — 16)} for Rê 
44. S = {(0, 0,0), (1, 5, 6), (6, 2, 1)} for R° 


45. S = {(—1, 2,0, 0), (2, 0, — 1, 0), (3, 0, 0, 4), (0, 0, 5, 0)} 
for R4 

46. S = {(1, 0, 0, 1), (0, 2, 0, 2), (1, 0, 1, 0), (0, 2, 2, 0)} 
for R4 


Determining Whether a Set Is a Basis In Exercises 
47-50, determine whether S is a basis for P}. 


47.S={1-2P + Ë, —4 + £ĉ, 21+ 8, 5t} 

48. S = {4t — Ê, 5 + 2,5 + 34, -3P + 20} 
49. S = {4 — t, P, 6P, 3t + ©, —1 + 4t} 

50. S = {1 + 8,2,3 +5 + 2+ 22 + 2} 


Determining Whether a Set Is a Basis In Exercises 51 
and 52, determine whether S is a basis for M, 2. 


s IE IE IE a 
s AE IL Jes 
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Determining Whether a Set Is a Basis In Exercises 
53-56, determine whether S is a basis for R°. If it is, write 
u = (8, 3, 8) as a linear combination of the vectors in S. 


53. S = {(4, 3, 2), (0, 3, 2), (0, 0, 2)} 
54. S = {(1, 0,0), (1, 1, 0), (1, 1, 1)} 
55. S = {(0, 0, 0), (1, 3, 4), (6, 1, —2)} 
56. S = {(3,3, 1), (1, 3, 0), (2, 12, 6)} 


Finding the Dimension of a Vector Space In Exercises 
57-64, find the dimension of the vector space. 


57. R6 58. R 

59. P, 60. P, 

61. M,, 62. M,, 

63. R?" 64. Pan p m21 


65. Find a basis for the vector space of all 3 x 3 diagonal 
matrices. What is the dimension of this vector space? 


66. Find a basis for the vector space of all 3 x 3 symmetric 
matrices. What is the dimension of this vector space? 


67. Find all subsets of the set 
S = {(1, 0), (0, 1), (1, 1)} 


that form a basis for R?. 
68. Find all subsets of the set 


S= {(, 3, —2), (—4, 1, 1), (—2, 7, —3), (2, 1, 1)} 
that form a basis for R?. 


69. Find a basis for R? that includes the vector (2, 2). 


70. Find a basis for R? that includes the vectors (1, 0, 2) and 
(0, 1, 1). 


Geometric Description, Basis, and Dimension In 
Exercises 71 and 72, (a) give a geometric description 
of, (b) find a basis for, and (c) find the dimension of the 
subspace W of R?. 

71. W = {(2t, t): tis a real number} 


72. W = {(0, t): tis a real number} 


Geometric Description, Basis, and Dimension In 
Exercises 73 and 74, (a) give a geometric description 
of, (b) find a basis for, and (c) find the dimension of the 
subspace W of R°. 


73. W = {(2t, t, — t): tis areal number} 


74. W = {(2s — t, s, t): s and t are real numbers} 


Basis and Dimension In Exercises 75-78, find (a) a 
basis for and (b) the dimension of the subspace W of R4. 


75. W = {(2s — t, s, t, s): s and t are real numbers} 

76. W = {(5t, — 31, t, t): tis a real number} 

77. W = {(0, 6t, t, — t): tis a real number} 

78. W = {(s + 4t, t, s, 2s — t): s and t are real numbers} 


True or False? In Exercises 79 and 80, determine 
whether each statement is true or false. If a statement 
is true, give a reason or cite an appropriate statement 
from the text. If a statement is false, provide an example 
that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


79. (a) If dim(V) = n, then there exists a set of n — 1 
vectors in V that span V. 
(b) If dim(V) = n, then there exists a set of n + 1 
vectors in V that span V. 
80. (a) If dim(V) = n, then any set of n + 1 vectors in V 
must be linearly dependent. 
(b) If dim(V) = n, then any set of n — 1 vectors in V 
must be linearly independent. 


81. Proof Prove that if S = {v,,v,,...,v,,} is a basis 
for a vector space V and c is a nonzero scalar, then the 
set S} = {cV}, cV>,. . ., cv, } is also a basis for V. 

82. Proof Prove Theorem 4.12. 


83. Proof Prove that if W is a subspace of a finite 
dimensional vector space V, then dim(W) < dim(V). 


84. CAPSTONE 


(a) A set S, consists of two vectors of the form 
u = (uj, Uy, uz). Explain why S, is nota basis for R°. 


(b) A set S, consists of four vectors of the form 
u = (uy, Uy, uz). Explain why S, is nota basis for R°. 

(c) A set S} consists of three vectors of the form 
u = (u,, uz, u3). Determine the conditions under 
which S; is a basis for R°. 


85. Proof Let S be a linearly independent set of vectors 
from a finite dimensional vector space V. Prove that 
there exists a basis for V containing S. 


86. Guided Proof Let S be a spanning set for a finite 
dimensional vector space V. Prove that there exists a 
subset S’ of S that forms a basis for V. 


Getting Started: S is a spanning set, but it may not be 
a basis because it may be linearly dependent. You need 
to remove extra vectors so that a subset S’ is a spanning 
set and is also linearly independent. 


(i) If Sis a linearly independent set, then you are done. 
If not, remove some vector v from S that is a linear 
combination of the other vectors in S. Call this set S,. 


(ii) If S, is a linearly independent set, then you are 
done. If not, then continue to remove dependent 
vectors until you produce a linearly independent 
subset S’. 


(iii) Conclude that this subset is the minimal spanning 
set S’. 
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4.6 Rank of a Matrix and Systems of Linear Equations 


Find a basis for the row space, a basis for the column space, and 
the rank of a matrix. 


Find the nullspace of a matrix. 


Find the solution of a consistent system Ax = b in the form x, + Xp. 


ROW SPACE, COLUMN SPACE, AND RANK OF A MATRIX 


In this section, you will investigate the vector space spanned by the row vectors (or 
column vectors) of a matrix. Then you will see how such vector spaces relate to solutions 
of systems of linear equations. 

For an m x n matrix A, recall that the n-tuples corresponding to the rows of A are 
the row vectors of A. 


Row Vectors of A 


a); 42 +--+ Ain (Bigs Gis: «ag ig) 
Aa {1 %2 -> Gn (dijz > ay) 
amı Am2 ERSEN amn (an Am2 BE A amn) 


Similarly, the m x 1 matrices corresponding to the columns of A are the column 
vectors of A. 


Column Vectors of A 


ai A2 >.> Ain Ay, || 412 Ain 
e" e oo 4, || 422 Ay, 

ami Am2 ewo Ginn ay, 1 m2 Ginn 
EXAMPLE 1 Row Vectors and Column Vectors 


0 1 =l 
=2 3 4 


and the column vectors are | I p and E. ai 


For the matrix A = | | the row vectors are (0, 1, — 1) and (—2, 3, 4) 


In Example 1, note that for an m x n matrix A, the row vectors are vectors in R” 
and the column vectors are vectors in R”. This leads to the definitions of the row space 
and column space of a matrix listed below. 


Definitions of Row Space and Column Space of a Matrix 


Let A be an m x n matrix. 


1. The row space of A is the subspace of R” spanned by the row vectors of A. 
2. The column space of A is the subspace of R” spanned by the column 
vectors of A. 


Recall that two matrices are row-equivalent when one can be obtained from the 
other by elementary row operations. The next theorem tells you that row-equivalent 
matrices have the same row space. 
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REMARK 


Theorem 4.13 states that 
elementary row operations 
do not change the row space 
of a matrix. Elementary row 
operations can, however, 
change the column space 

of a matrix. 


THEOREM 4.13 Row-Equivalent Matrices 
Have the Same Row Space 


If an m x n matrix A is row-equivalent to an m X n matrix B, then the row space 
of A is equal to the row space of B. 


PROOF 


The rows of B can be obtained from the rows of A by elementary row operations (scalar 
multiplication and addition), so it follows that the row vectors of B can be written as 
linear combinations of the row vectors of A. The row vectors of B lie in the row space 
of A, and the subspace spanned by the row vectors of B is contained in the row space 
of A. But it is also true that the rows of A can be obtained from the rows of B by 
elementary row operations. So, the two row spaces are subspaces of each other, making 


them equal. | 


If a matrix B is in row-echelon form, then its nonzero row vectors form a linearly 
independent set. (Verify this.) Consequently, they form a basis for the row space of B, 
and by Theorem 4.13 they also form a basis for the row space of A. The next theorem 
states this important result. 


THEOREM 4.14 Basis for the Row Space of a Matrix 


If a matrix A is row-equivalent to a matrix B in row-echelon form, then the 
nonzero row vectors of B form a basis for the row space of A. 


j EXAMPLE 2 Finding a Basis for a Row Space 


Find a basis for the row space of 


1 3 1 3 


0 1 1 0 
A=|-3 0 6 =] 
3 4 -2 1 
2 0 -4 -2 
SOLUTION 
Using elementary row operations, rewrite A in row-echelon form as shown below. 
1 3 1 3] w 
0 1 1 Oj w 
B=]ļ|0 0 0 1} w 
0 0 0 0 
0 0 0 0 
By Theorem 4.14, the nonzero row vectors of B, w, = (1, 3, 1,3), w, = (0, 1, 1, 0), 
and w} = (0, 0, 0, 1), form a basis for the row space of A. | 


The technique used in Example 2 to find a basis for the row space of a matrix can 
be used to find a basis for the subspace spanned by the set S = {v}, V5,. . ., V,} in R”. 
Use the vectors in S to form the rows of a matrix A, then use elementary row operations 
to rewrite A in row-echelon form. The nonzero rows of this matrix will then form a 
basis for the subspace spanned by S. Example 3 demonstrates this process. 
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EXAMPLE 3 Finding a Basis for a Subspace 


Find a basis for the subspace of R? spanned by 
S = 1 Vins Va; v3} = i= l; 2; 5); (2, 0, 3), (5, 1, 8)}. 


SOLUTION 
Use v,, Vz, and v, to form the rows of a matrix A. Then write A in row-echelon form. 
= 2 Fw 1 -2 -3|™% 
A= 3 0 3\v, => B=|0 1 3 | w, 
5 1 8jv 0 0 0 


The nonzero row vectors of B, w, = (1, —2, —5) and w, = (0, 1, 3), form a basis 
for the row space of A. That is, they form a basis for the subspace spanned by 


S = {v,, Vz V3}- | 


To find a basis for the column space of a matrix A, you have two options. On the one 
hand, you could use the fact that the column space of A is equal to the row space of AT 
and apply the technique of Example 2 to the matrix A’. On the other hand, observe that 
although row operations can change the column space of a matrix, they do not change the 
dependency relationships among columns. (You are asked to prove this in Exercise 80.) 
For example, consider the row-equivalent matrices A and B from Example 2. 


1 3 1 3 1 3 1 3 

0 1 1 0 0 1 1 0 

A=1!-3 0 6 =i B= 10 0 0 1 

3 4 -2 1 0 0 0 0 

2 0 -4 -2 0 0 0 0 

a, a, a; ay b; b, b; b, 
Notice that columns 1, 2, and 3 of matrix B satisfy b, = —2b, + b,, and the 
corresponding columns of matrix A satisfy a, = —2a, + a,. Similarly, the column 


vectors b,, b,, and b, of matrix B are linearly independent, as are the corresponding 
columns of matrix A. 

The next two examples show how to find a basis for the column space of a matrix 
using these methods. 


——— l Finding a Basis for the Column 
EXAMPLE 4 Space of a Matrix (Method 1) 


Find a basis for the column space of matrix A from Example 2 by finding a basis for 
the row space of A’. 


SOLUTION 
Write the transpose of A and use elementary row operations to write AT in row-echelon 
form. 
1 0 -3 3 2 1 0 =3 3 2 |wi 
3 1 0 4 0 0 1 9 -5 —-6|w, 
T= —> 2 
A 1 1 6 -2 —4 0 0 1 -1 =L 
3 0 =] 1 -=2 0 0 0 0 0 


So, w, = (1, 0, —3, 3, 2), w, = (0, 1,9, —5, —6), and w, = (0,0, 1, —1, —1) form 
a basis for the row space of A’. This is equivalent to saying that the column vectors 
OQ 0-3 3 2F [0 1 9 -5 -—6ļ|,an [0 0 1 —1 —1]" forma 
basis for the column space of A. | 
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EXAMPLE 5 


Finding a Basis for the Column 
Space of a Matrix (Method 2) 


Find a basis for the column space of matrix A from Example 2 by using the dependency 
relationships among columns. 


SOLUTION 


In Example 2, row operations were used on the original matrix A to obtain its row-echelon 

form B. As mentioned earlier, in matrix B, the first, second, and fourth column vectors 
REMARK are linearly independent (these columns have the leading 1’s), as are the corresponding 
columns of matrix A. So, a basis for the column space of A consists of the vectors 


Notice that the row-echelon 
form B tells you which 1 3 3 
columns of A form the basis 


for the column space. You do o l 0 
not use the column vectors ~3}, 0), and -1 
of B to form the basis. 3 4 1 
2! Jo -2 m 


Notice that the basis for the column space obtained in Example 5 is different than 
that obtained in Example 4. Verify that these bases both span the column space of A by 
writing the columns of A as linear combinations of the vectors in each basis. 

Also notice in Examples 2, 4, and 5 that both the row space and the column space 
of A have a dimension of 3 (because there are three vectors in both bases). The next 
theorem generalizes this. 


THEOREM 4.15 Row and Column Spaces 
Have Equal Dimensions 


The row space and column space of an m x n matrix A have the same dimension. 


Let Vi, V>,. . ., V,, be the row vectors and u}, U,,. . . , u,, be the column vectors of 
ai Ag +++ Ay 
a a1 aa a azn | 
amı Am2 oe amn 
Assume the row space of A has dimension r and basis S$ = {b,, i PE b,}, where 
b, = (b, b>... .,;,). Using this basis, write the row vectors of A as 
Vi = Cubi + cyby te= = + Cib, 
V = Cubi + Caba +--+ + cb, 
Vin = CD, + Cm2D2 Tea Cm/D,- 


Rewrite this system of vector equations as shown below. 


(a1, aiz. -> ain) = chb bi». . <> bin) + cia(bz» ba». . -> Don) Piate Cib» Diggs a4 
(451, a2.» - -o Aan) = Cy (bi, bi». - <o bin) + Caba» ba. + -> by,) oe ere ca (b, A E 


(am Am» + +> Ann) = Ci (D435 biz Vat bin) T Cma(ba1» baz, em rg bzn) Toe ea G (Das Dy; Sate RS b ) 


mr rn 


Now, take only entries corresponding to the first column of matrix A to obtain the 
system of scalar equations shown on the next page. 
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REMARK 


Some texts distinguish 
between the row rank and 
the column rank of a matrix, 
but these ranks are equal 
(Theorem 4.15). So, this text 
will not distinguish between 
them. 
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Ay, = Cy Dy + Ciba +e + + Cba 
Ay, = Cbi + Cabai F: + + + Caba 
Gin} = Cm 11 + Cor TURSE Cm Pp 


Similarly, for the entries of the jth column, you can obtain the system below. 


Ay; = Cuby + Ciba, ++ + + Cuby 
Any = Cubi + Coby, F: + + + Coby 
anj = Cmibij + Cm2b2j P a Cmr b,j 


Now, let the vectors 
7 


c= [eip Cay « «+ Cal- 


Then the system for the jth column can be rewritten in a vector form as 


u; = Dye; + be, ++ + + + bye 
Put all column vectors together to obtain 
u = [a4 an ..- amf = Bye, + bye, ++ « + + bye, 
w = [ap an ... aml = bici + byt, ++ + + bye, 
u, = [a,, a amn” = bin bye eet ee 
n In A mn. ln~1 2n™2 mer" 


Each column vector of A is a linear combination of r vectors, so you know that the 
dimension of the column space of A is less than or equal to r (the dimension of the row 
space of A). That is, 


dim(column space of A) < dim(row space of A). 


Repeating this procedure for A’, you can conclude that the dimension of the column 
space of A” is less than or equal to the dimension of the row space of A’. But this 
implies that the dimension of the row space of A is less than or equal to the dimension 
of the column space of A. That is, 


dim(row space of A) < dim(column space of A). 


So, the two dimensions must be equal. | 


The dimension of the row (or column) space of a matrix is the rank of the matrix. 


Definition of the Rank of a Matrix 


The dimension of the row (or column) space of a matrix A is the rank of A and 
is denoted by rank(A). 


EXAMPLE 6 Finding the Rank of a Matrix 


To find the rank of the matrix A below, convert to a matrix B in row-echelon form as shown. 


I =2 0 1 1 -2 0 1 
A=|2 1 5. =3 => B=(0 1 1 -l 
0 1 3 5 (0) 0 1 3 
The matrix B has three nonzero rows, so the rank of A is 3. | 
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REMARK 


The nullspace of A is also 
called the solution space of 
the system Ax = 0. 


YOUR COMPANY 
2255 YOUR STREET 
YOUR CITY NY 13215-5523 


YOUR COMPANY 
2255 YOUR STREET 
YOUR CITY NY 13215-5523 


THE NULLSPACE OF A MATRIX 


Row and column spaces and rank have some important applications to systems of 
linear equations. Consider first the homogeneous linear system Ax = 0, where A 
is an m x n matrix, x =[x, x, ... x,]’ is the column vector of variables, and 
0=[0 0... OF is the zero vector in R”. The next theorem tells you that the set 
of all solutions of this homogeneous system is a subspace of R”. 


THEOREM 4.16 Solutions of a Homogeneous System 


If A is an m x n matrix, then the set of all solutions of the homogeneous system 
of linear equations Ax = 0 is a subspace of R” called the nullspace of A and 
is denoted by N(A). So, 


N(A) = {x E R": Ax = 0}. 


The dimension of the nullspace of A is the nullity of A. 


PROOF 


The size of A is m x n, so you know that x has size n x 1, and the set of all solutions 
of the system is a subset of R”. This set is clearly nonempty, because AO = 0. Verify 
that it is a subspace by showing that it is closed under the operations of addition and 
scalar multiplication. Let x, and x, be two solution vectors of the system Ax = 0, and 
let c be a scalar. Both Ax, = 0 and Ax, = 0, so you know that 


A(x, + x) = Ax, + Ax, =0+0=0 Addition 
and 
A(cx,) = c(Ax,) = c(0) = 0. Scalar multiplication 


So, both (x, + x,) and cx, are solutions of Ax = 0, and you can conclude that the set 
of all solutions forms a subspace of R”. | 


LINEAR The U.S. Postal Service uses barcodes to represent such 
ALGEBRA information as ZIP codes and delivery addresses. The 
ZIP + 4 barcode shown at the left starts with a long bar, 
APPLIED then has a sequence of short and long bars to represent 
each digit in the ZIP + 4 code, an additional digit for error 
checking, and then the code ends with a long bar. The code 
for the digits is shown below. 


o=lhu l=ulll 2=uhl 3=ulh 4=ilul 


seahh 6=alhn 7=lul s=luh o=hha 


The error checking digit is such that when it is summed 
with the digits in the ZIP + 4 code, the result is a multiple 
of 10. (Verify this, as well as whether the ZIP + 4 code 
shown is coded correctly.) More sophisticated barcodes 
will also include error correcting digit(s). In an analogous 
way, matrices can be used to check for errors in transmitted 
messages. Information in the form of column vectors can 
be multiplied by an error detection matrix. When the 
resulting product is in the nullspace of the error detection 
matrix, no error in transmission exists. Otherwise, an error 
exists somewhere in the message. If the error detection 
matrix also has error correction, then the resulting matrix 
product will also tell where the error is occurring. 
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REMARK 


Although Example 7 shows that 
the basis spans the solution 
set, it does not show that the 
vectors in the basis are linearly 
independent. When you solve 
homogeneous systems from 
the reduced row-echelon form, 
the spanning set is always 
linearly independent. Verify 
this for the basis found in 
Example 7. 
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EXAMPLE 7 Finding the Nullspace of a Matrix 


Find the nullspace of the matrix. 


1 2 =2 1 
A=13 6 =5 4 
1 2 0 3 


SOLUTION 


The nullspace of A is the solution space of the homogeneous system 
Ax = 0. 


To solve this system, you could write the augmented matrix [A 0] in reduced 
row-echelon form. However, the last column of the augmented matrix consists entirely 
of zeros and will not change as you perform row operations, so it is sufficient to find 
the reduced row-echelon form of A. 


1 2 =2 1 1 2 0 3 
A=}3 6 =5 4| => Jo 0 1 1 
1 2 0 3 0 0 0 0 


The system of equations corresponding to the reduced row-echelon form is 


X, + 2X5 + 3x,=0 
X, t xX = 0. 


Choose x, and x, as free variables to represent the solutions in parametric form. 


x, = 2s — 34. HS, xp Sh x Ht 


This means that the solution space of Ax = 0 consists of all solution vectors of the form 


x, =25 =.3t =2 =a 
ENEE Ss 1 P 0 l 
X3 = 0 =1 
X4 t 0 1 
So, a basis for the nullspace of A consists of the vectors 
=2 =3 

1 

0 and a i 

0 1 


In other words, these two vectors are solutions of Ax = 0, and all linear combinations 
of these two vectors are also solutions. | 


In Example 7, matrix A has four columns. Furthermore, the rank of A is 2, and the 
dimension of the nullspace is 2. So, 


Number of columns = rank + nullity. 
One way to see this is to look at the reduced row-echelon form of A. 


1 2 0 3 
0 0 1 1 
0 0 0 0 


The columns with the leading 1’s (columns 1 and 3) determine the rank of the 
matrix. The other columns (2 and 4) determine the nullity of the matrix because they 
correspond to the free variables. The next theorem generalizes this relationship. 
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THEOREM 4.17 Dimension of the Solution Space 


If A is an m X n matrix of rank r, then the dimension of the solution space of 
Ax = Oisn — r. That is, n = rank(A) + nullity(A). 


PROOF 


A has rank r, so you know it is row-equivalent to a reduced row-echelon matrix B with 
r nonzero rows. No generality is lost by assuming that the upper left corner of B has the 
form of the r x r identity matrix J. Moreover, the zero rows of B contribute nothing to 
the solution, so discard them to form the r x n matrix B’, where B’ is the augmented 
matrix [J, C]. The matrix C has n — r columns corresponding to the variables x,., ,, 


X49). + -> Xp and the solution space of Ax = 0 can be represented by the system 
x, + CX F CXe $+ Cy pen = 0 
X + CoX-41 F Coke $2 E Cy gt, = 0 
X, T CX +1 T C aXr+2 see agh Cp n=rYn = 0. 


Solving for the first r variables in terms of the last n — r variables produces n — r vectors 
in the basis for the solution space, so the solution space has dimension n — r. | 


Example 8 illustrates this theorem and further explores the column space of a matrix. 


i E XAMPLE g I] Rank, Nullity of a Matrix, and Basis for the 
Column Space 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


Let the column vectors of the matrix A be denoted by a}, a,, a;, a4, and a,. Find (a) the 
rank and nullity of A, and (b) a subset of the column vectors of A that forms a basis for 
the column space of A. 


1 0 =2 1 0 
0 =I =3 1 3 


a =2 =l 1 —1 3 
(0) 3 9 0 —-12 
a, a, a, a, as 
SOLUTION 
Let B be the reduced row-echelon form of A. 
1 0 -2 1 0 1 0 =2 0 1 
0 =1 =3 1 3 (0) 1 3 0 —4 
ASIa e g e a = Bl o o Ae a 
(0) 3 9 0 =12 (0) 0 0 (0) 0 


a. B has three nonzero rows, so the rank of A is 3. Also, the number of columns of A 
isn = 5, which implies that the nullity of A is n — rank = 5 — 3 = 2. 


b. The first, second, and fourth column vectors of B are linearly independent, so the 
corresponding column vectors of A, 


1 0 1 
=] 
a = ak a, = i and a, = 
0 3 0 


form a basis for the column space of A. 
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SOLUTIONS OF SYSTEMS OF LINEAR EQUATIONS 


You now know that the set of all solution vectors of the homogeneous linear system 
Ax = 0 is a subspace. The set of all solution vectors of the nonhomogeneous system 
Ax = b, where b + 0, is not a subspace because the zero vector is never a solution of a 
nonhomogeneous system. There is a relationship, however, between the sets of solutions 
of the two systems Ax = 0 and Ax = b. Specifically, if x, is a particular solution of the 
nonhomogeneous system Ax = b, then every solution of this system can be written in 
the form x = x, + x; where x, is a solution of the corresponding homogeneous system 
Ax = 0. The next theorem states this important concept. 


THEOREM 4.18 Solutions of a Nonhomogeneous 
Linear System 


If x, is a particular solution of the nonhomogeneous system Ax = b, then 
every solution of this system can be written in the form x = x, + x, where x, is 
a solution of the corresponding homogeneous system Ax = 0. 


PROOF 


Let x be any solution of Ax = b. Then (x — x,) is a solution of the homogeneous 
system Ax = 0, because 


A(x — x,) = Ax - Ax, = b—b=0. 


Letting x, = x — x,, you have x = x, + X, 


— “2 Finding the Solution Set of a 
EXAMPLE 9 Nonhomogeneous System 


Find the set of all solution vectors of the system of linear equations. 


x, —2x,+ x= 5 
3x, + x, — 5x, = 8 
ži + 2x5 = 5x4 = = 
SOLUTION 
The augmented matrix for the system Ax = b reduces as shown below. 
1 0 -2 1 5 1 0- = 2 1 5 
3 1. -—5 0 8; => Jo 1 L s3 =7 
1 2 0 =): 9 0 0 0 0 0 


The system of linear equations corresponding to the reduced row-echelon matrix is 


x =t x = 5 
Xo + X, — 3x, = —7. 


Letting x, = s and x, = t, write a representative solution vector of Ax = b as shown 


below. 
x, 5+2s-t 5 2 -1 
X =7 = SF 3t =7 =] 3 
= = = -+ +t =x, +s +t 
x | x, O+s+0F of) 2 0) 5 T T h 
xy O+0s+¢ 0 0 1 


x, is a particular solution vector of Ax = b, and x, = su, + fu, represents an arbitrary 
vector in the solution space of Ax = 0. 
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REMARK 


The reduced row-echelon form 
of [A blis 


1 0 1 3 
0 1 -2 -4 
0 0 0 0 


(verify this). So, there are 
infinitely many ways to write b 
as a linear combination of the 
columns of A. 


Chapter 4 Vector Spaces 


The next theorem describes how the column space of a matrix can be used to 
determine whether a system of linear equations is consistent. 


THEOREM 4.19 Solutions of a System of Linear Equations 


The system Ax = b is consistent if and only if b is in the column space of A. 


PROOF 


For the system Ax = b, let A, x, and b be the m x n coefficient matrix, the n x 1 
column matrix of variables, and the m x 1 right-hand side, respectively. Then 


Ai A ++ + Ain ||% ay a2 in 

a, a a K a a a 
g= 22 2n 2| =x 21 +X, 2 pad eti, 2n 

amı Am2 Aoa amn Xn amı Am2 amn 


So, Ax = b if and only if b = [b, b, b,, |" is a linear combination of the 
columns of A. That is, the system is consistent if and only if b is in the subspace of R” 
spanned by the columns of A. | 


De ESS Consistency of a System of Linear Equations 


Consider the system of linear equations 


xt ===] 
x, +i, = 3 
3x, + 2x,-x,= 1. 


The augmented matrix for the system is 


1 L =]. S] 
[A b]J=]1 0 1. 3l 

3 2 =l 1 

a, a, a; b 


Notice that b = 2a, — 2a, + a3. So, b is in the column space of A, and the system of 
linear equations is consistent. 


The summary below presents several major results involving systems of linear 
equations, matrices, determinants, and vector spaces. 


Summary of Equivalent Conditions for Square Matrices 


If A is ann x n matrix, then the conditions below are equivalent. 


. A is invertible. 

. Ax = b has a unique solution for any n x | matrix b. 
. Ax = 0 has only the trivial solution. 

. A is row-equivalent to J,,. 

„|A| #0 

. Rank(A) = n 

. The n row vectors of A are linearly independent. 

. The n column vectors of A are linearly independent. 


1 
2 
3 
4 
5 
6 
7 
8 
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mesa 
4. 6 Exercises See CalcChat.com for worked-out solutions to odd-numbered exercises. h 


Row Vectors and Column Vectors In Exercises 1—4, Finding a Basis for a Column Space and Rank In 
write (a) the row vectors and (b) the column vectors of Exercises 21-26, find (a) a basis for the column space 
the matrix. and (b) the rank of the matrix. 
0 -2 2 4 
1. [9 "3 2. [6 5 -1] 21. f | 22. [1 2 3] 
0 3 -4 4 20 31 
1 2 4 
3. b i l 4} 4 0 -1 23. E f i 24. |6 -5 -6 
os Ss -6 1 1 2 -11 -16 


Finding a Basis for a Row Space and Rank In 


Exercises 5-12, find (a) a basis for the row space and 25. 
(b) the rank of the matrix. oe Ae 
À F 2 A ta), 
5 6. [0 1 =2 
| s| [ ] 2 4 -2 1 1 
2 5 2 5 4 -2 2 
1 = 2 
T | 4 5 8. |-—2 —5 26. | 4 3 1 1 2 
—6 -15 2 -4 2 -1 1 
1 6 18 2-3 1 O 1 4 2 -1 
; 40 11 10. 1 
A = o i ue 9 ° - : Finding the Nullspace of a Matrix In Exercises 27—40, 
find the nullspace of the matrix. 
=p -4 4 5 2 =1 2. =] 
Z2 -4 4 9 29. A = [1 3] 30A=[1 4 2] 
4 0 2 3 1 3 1 4 2 
2 3 ef 2 9) aa 4 9 
12. | 5 2 2 1 = 
4 0 2 2 33. A = 
2 =2 0 0 


Finding a Basis for a Subspace In Exercises 13-16, 
find a basis for the subspace of R? spanned by S. 35. A = 


13. S = {(1, 2, 4), (-1, 3, 4), (2, 3, 1)} 

14. S = {(2, 3, —1), (1, 3, —9), (0, 1, 5)} 

15. S = {(4, 4, 8), (1, 1, 2), (1, 1, 1)} 37. A = 
16. S = {(1, 2, 2), (— 1, 0, 0), (1, 1, 1)} 


Finding a Basis for a Subspace In Exercises 17-20, 38. A = 
find a basis for the subspace of R* spanned by S. 


17. S = {(2, 9, — 2, 53), (—3, 2, 3, — 2), (8, —3, — 8, 17), 


2 6 3 1 
(0, —3, 0, 15)} 7 7 pe 
18. S = {(6, —3, 6, 34), (3, —2, 3, 19), (8, 3, —9, 6), 39. A=] 4 i 4 
(=2,0;6;=5)} 0 6 2 0 
19. S T {(-3, 2, D5, 28), (=6, 1, —8, = 1), 
(14, —10, 12, — 10), (0, 5, 12, 50)} z i 5 
20. S = {(2, 5, —3, —2), (—2, —3, 2, — 5), (1, 3, —2, 2), WAI 5 i 4 
(=1, —5, 3, 5)} 
0 > ő 
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Rank, Nullity, Bases, and Linear Independence In 
Exercises 41 and 42, use the fact that matrices A and B 
are row-equivalent. 


(a) Find the rank and nullity of A. 

(b) Find a basis for the nullspace of A. 

(c) Find a basis for the row space of A. 

(d) Find a basis for the column space of A. 


(e) Determine whether the rows of A are linearly 
independent. 


(£) Let the columns of A be denoted by a}, a,, a3, a,,anda;. 
Determine whether each set is linearly independent. 


(i) {ay Ad, a,} (ii) {ay Ay, az) Gii) {ay a3, as} 


41. A= 


oo or fFWN Ke 
oorco ON WN 


| 


Re We N 
Ww 
| 
Nm 


42. A= 


ooor 
ooro 
o 


Finding a Basis and Dimension In Exercises 43—48, 
find (a) a basis for and (b) the dimension of the solution 
space of the homogeneous system of linear equations. 


43. -x+ y+ z=0 44, x — 2y + 3z=0 
3x - y =0 —3x + by — 9z = 0 
2x — 4y- 5z=0 

45. 3x, + 3x, + 15x, + 11x, = 0 
Hypo Bxy at y= 
2x, + 3x, + 11x, + 8x, =0 

46. 2x, + 2x, + 4x, — 2x, =0 
xi + 2x, + x, + 2x, = 0 


—x, + x, + 4x, — 2x, =0 
47. 9x, — 4x, — 2x, — 20x, = 0 
12x, — 6x, — 4x, — 29x, = 0 
Shy = 2 = Tx4=0 
Bi = 2K = Xe 8x, = 0 
48. x, + 3x, + 2x, + 22x, + 13x; = 0 
Xi + X,- Ix,+ x50 


3x, + 6x, + 5x, + 42x, + 27x; = 0 


© 56. 5x, 


Nonhomogeneous System In Exercises 49-56, 
determine whether the nonhomogeneous system Ax = b 
is consistent. If it is, write the solution in the form 
X = x, + X, where x, is a particular solution of Ax = b 
and x, is a solution of Ax = 0. 
49. x- 4y= 17 50. 

3x — 12y= 51 

—2x + 8y = —34 


x+2y- 4z=-1 
—3x — 6y + 12z= 3 


51. x + 3y + 10z = 18 52. 2x- 4y+5z= 8 
—2x + Ty + 32z = 29 —7x + 14y + 4z = —28 
—x + 3y + 14z = 12 3x— 6y+ z= 12 

x+ y+ 2z= 8 

53. 3x — 8y + 4z = 19 

—6y+ 27+ 4w= 5 
5x +22z+ w= 29 
x= 2y 2 = 8 


54. 3w — 2x + 16y- 2z= -7 
—w + 5x — 14y + 18z = 29 
3w — x+ l4 + 2z= 1 


@>5. X, + 2x, + x3 + xy t+ Sx, = 0 


—5x, = 10x, + 3x, + 3x, + 55x, = —8 
X, + 2x, + 2x3 = 3x, 5y = 14 
=j > 2x xg xg t Tox = 2 
— 4x, + 12x, — 33x, + 14x, = —4 
—2x, + x, —- 6x,+12x,- 8%,= 1 
2X, = X,+ 6x, = 12x,+ 8x, = =1 
Consistency of Ax = b In Exercises 57-62, determine 


whether b is in the column space of A. If it is, write b as 
a linear combination of the column vectors of A. 


=] 2 2 
sa [i 2] -[ 
1 3 2 1 
59. A=|-1 1 2), b= ]1 
0 1 1 0 
1 3 0 1 
60. A=|-1 1 0j b=] 2 
2 0 1 =3 
=1 =1 1 0 
61. A = 1 0 1], b=] 3 
=3, =2 1 =3 
5 4 4 =9 
62. A=|-3 1 -2|, b= 11 
1 0 8 =25 
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63. 


64. 


65. 


66. 


67. 


68. 


69. 


70. 


71. 


72. 


Proof Prove that if A is not square, then either the row 
vectors of A or the column vectors of A form a linearly 
dependent set. 


Give an example showing that the rank of the product of 
two matrices can be less than the rank of either matrix. 


Give examples of matrices A and B of the same size 
such that 


(a) rank(A + B) < rank(A) and rank(A + B) < rank(B) 
(b) rank(A + B) = rank(A) and rank(A + B) = rank(B) 
(c) rank(A + B) > rank(A) and rank(A + B) > rank(B). 


Proof Prove that the nonzero row vectors of a matrix 
in row-echelon form are linearly independent. 


Let A be an m x n matrix (where m < n) whose rank is r. 
(a) What is the largest value r can be? 


(b) How many vectors are in a basis for the row space 
of A? 

(c) How many vectors are in a basis for the column 
space of A? 

(d) Which vector space R* has the row space as a 
subspace? 

(e) Which vector space R* has the column space as a 
subspace? 

Show that the three points (x,, y1), (X2, Y2), and (x3, y3) 

in a plane are collinear if and only if the matrix 


has rank less than 3. 

Consider an m x n matrix A and ann x p matrix B. Show 
that the row vectors of AB are in the row space of B and 
the column vectors of AB are in the column space of A. 


Find the rank of the matrix 
1 2 Sosa Nn 
n+1 n+2 n+3 ess 2n 
2n + 1 2n +2 2n+3 ... 3n 
wW—nt1 n—-n+2 wW—-nt+3 ... P 


forn = 2, 3, and 4. Can you find a pattern in these ranks? 

Proof Prove each property of the system of linear 

equations in n variables Ax = b. 

(a) If rank(A) = rank([A b]) = n, then the system has 
a unique solution. 

(b) If rank(A) = rank([A b]) < n, then the system has 
infinitely many solutions. 

(c) If rank(A) < rank([A b]), then the system is 
inconsistent. 


Proof Let A be an mxn matrix. Prove that 
N(A) C MATA). 


Tr 


4.6 Exercises 207 


ue or False? In Exercises 73-76, determine whether 


each statement is true or false. If a statement is true, give 
a reason or cite an appropriate statement from the text. 
If a statement is false, provide an example that shows the 
statement is not true in all cases or cite an appropriate 
statement from the text. 


73 


74. 


75. 


76. 


77. 


79 


80. 


81. 


. (a) The nullspace of a matrix A is the solution space of 
the homogeneous system Ax = 0. 


(b) The dimension of the nullspace of a matrix A is the 
nullity of A. 


(a) Ifan m x n matrix A is row-equivalent to an m x n 
matrix B, then the row space of A is equivalent to 
the row space of B. 


(b) If Ais an m x n matrix of rank r, then the dimension 
of the solution space of Ax = Qis m — r. 


(a) Ifanm x nmatrix B can be obtained from elementary 
row operations onan m X nmatrix A, then the column 
space of B is equal to the column space of A. 


(b) The system of linear equations Ax = bis inconsistent 
if and only if b is in the column space of A. 


(a) The column space of a matrix A is equal to the row 
space of A’. 


(b) The row space of a matrix A is equal to the column 
space of A’. 


Let A and B be square matrices of order n satisfying 
Ax = Bx for all x in R”. 


(a) Find the rank and nullity of A — B. 
(b) Show that A and B must be identical. 


78. CAPSTONE The dimension of the row 
space of a3 x 5 matrix A is 2. 


(a) What is the dimension of the column space of A? 
(b) What is the rank of A? 


(c) What is the nullity of A? 


(d) What is the dimension of the solution space of the 
homogeneous system Ax = 0? 


. Proof Let A be an m x n matrix. 


(a) Prove that the system of linear equations Ax = b is 
consistent for all column vectors b if and only if the 
rank of A is m. 


(b) Prove that the homogeneous system of linear 
equations Ax = 0 has only the trivial solution if and 
only if the columns of A are linearly independent. 


Proof Prove that row operations do not change the 
dependency relationships among the columns of an 
m x n matrix. 


Writing Explain why the row vectors of a 4 x 3 


matrix form a linearly dependent set. (Assume all 
matrix entries are distinct.) 
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208 Chapter 4 Vector Spaces 


4.7 Coordinates and Change of Basis 


Į Find a coordinate matrix relative to a basis in R”. 
Find the transition matrix from the basis B to the basis B’ in R”. 
J Represent coordinates in general n-dimensional spaces. 


COORDINATE REPRESENTATION IN R” 


In Theorem 4.9, you saw that if B is a basis for a vector space V, then every vector x 
in V can be expressed in one and only one way as a linear combination of vectors in 
B. The coefficients in the linear combination are the coordinates of x relative to B. In 
the context of coordinates, the order of the vectors in the basis is important, so this will 
sometimes be emphasized by referring to the basis B as an ordered basis. 


Coordinate Representation Relative to a Basis 


Let B = {v}, V>,. . ., V,,} be an ordered basis for a vector space V and let x be a 
vector in V such that 


X = CV, + GV, ++ + F CKW 


The scalars c}, C>,. . .,¢, are the coordinates of x relative to the basis B. The 


coordinate matrix (or coordinate vector) of x relative to B is the column 
matrix in R” whose components are the coordinates of x. 


Cy 
C 
[x], = 5 


C 


n 


In R”, column notation is used for the coordinate matrix. For the vector 
X = (Xp X23. . .,x,,), the xs are the coordinates of x relative to the standard basis S 
for R”. So, you have 


Xi 
x 
Lx]; = : . 


x 


n 


EXAMPLE 1 Coordinates and Components in R” 


Find the coordinate matrix of x = (—2, 1, 3) in R? relative to the standard basis 
S = {(1, 0, 0), (0, 1, 0), (0, 0, 1)}. 


SOLUTION 
The vector x can be written as x = (—2, 1, 3) = —2(1, 0, 0) + 1(0, 1, 0) + 3(0, 0, 1), 
so the coordinate matrix of x relative to the standard basis is simply 
=2 
Ix]; =|] 1}. 
3 


The components of x are the same as its coordinates relative to the standard basis. | 
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X = 3(1, 0) + 2(1, 2) SARAT Finding a Coordinate Matrix 
y 
x], =[3] EXAMPLE 2 Relative to a Standard Basis 
The coordinate matrix of x in R? relative to the (nonstandard) ordered basis 
B = {v vo} = ACL 0), (1, 2)} is 


Find the coordinate matrix of x relative to the standard basis 
B= {u;, u,} = {(1, 0), (0, 1)}. 


Nonstandard basis: SOLUTION 
B ={(1, 0), C, 2)} 


The coordinate matrix of x relative to B is [x], = p so 
y x=5(1, 0) +4(0, 1) 2 


khel] x = 3v, + 2v, = 3(1, 0) + 2(1, 2) = (5,4) = 5(1, 0) + 4(0, 1). 


It follows that the coordinate matrix of x relative to B’ is 


Figure 4.17 compares these two coordinate representations. | 


Example 2 shows that the procedure for finding the coordinate matrix relative to a 
standard basis is straightforward. It is more difficult, however, to find the coordinate 
matrix relative to a nonstandard basis. Here is an example. 


~ Standard basis: 
B' = {(1, 0), (0, 1} 


Figure 4.17 Ps ee ar rae Finding a Coordinate Matrix 
EXAMPLE 3 Relative to a Nonstandard Basis 


Find the coordinate matrix of x = (1,2,—1) in R? relative to the (nonstandard) 
basis 


B' = {u,, uy, uy} = {(1, 0, 1), (0, — 1, 2), (2, 3, —5)}. 
SOLUTION 
Begin by writing x as a linear combination of u}, u,, and u}. 


X = cU; + cU, + C3, 
(1,2, —1) = c,(1,0, 1) + c,(0, — 1,2) + 22:3, —5) 


Equating corresponding components produces the system of linear equations and 
corresponding matrix equation below. 


Ci +2¢,= 1 
=c + 3c, = 
cit 26 = 5¢e,= —1 
1 o 21Tc, l 
0-1 sleli 2 
REMARK 1 2 —S Les z. 
It would be incorrect to write The solution of this system is c} = 5, c, = —8, and c} = —2. So, 


the coordinate matrix as 
x = 5(1,0, 1) + (—8)(0, —1, 2) + (—2)(2, 3, —5) 


5 
x= |), and the coordinate matrix of x relative to B’ is 
Do you see why? [x], =| —8]. 


=9 | 
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210 Chapter 4 Vector Spaces 


CHANGE OF BASIS IN R” 


The procedure demonstrated in Examples 2 and 3 is called a change of basis. That is, 
you were given the coordinates of a vector relative to a basis B and were asked to find 
the coordinates relative to another basis B’. 

For instance, if in Example 3 you let B be the standard basis, then the problem of 
finding the coordinate matrix of x = (1, 2, — 1) relative to the basis B’ becomes one of 
solving for c4, cy, and c, in the matrix equation 


il 0 2 1c, 1 

0-1 3ile|=| 2l. 

1 2 —5il¢, -1 
P ly Bal; 


The matrix P is the transition matrix from B' to B, where [x]; is the coordinate matrix 
of x relative to B’, and [x], is the coordinate matrix of x relative to B. Multiplication 
by the transition matrix P changes a coordinate matrix relative to B’ into a coordinate 
matrix relative to B. That is, 


P[x] B = [x] B- Change of basis from B’ to B 


To perform a change of basis from B to B’, use the matrix P~! (the transition matrix 
from B to B') and write 


[x], = P7'[x],. Change of basis from B to B’ 


So, the change of basis problem in Example 3 can be represented by the matrix equation 


ĉi =] 4 2 1 5 

G| = 3. =F =3 2|=]|-8]. 

ê; 1 2 1 1 2 
Pp Ix], [x], 


Generalizing this discussion, assume that 
= Y. a 
B={vj,,V.,...-,V,} and B’ = {u,u,...,u,} 


are two ordered bases for R”. If x is a vector in R” and 


Cy dı 
[x]; = i and [x]; = E 
c d 


n 


are the coordinate matrices of x relative to B and B’, then the transition matrix P from 
B’ to B is the matrix P such that 


[x], = Pix]. 


The next theorem tells you that the transition matrix P is invertible and its inverse is the 
transition matrix from B to B’. That is, 


[x]; = P'E] 


Coordinate Transition Coordinate 
matrix of x matrix matrix of x 
relative to B’ || from B to B’ || relative to B 


THEOREM 4.20 The Inverse of a Transition Matrix 


If P is the transition matrix from a basis B’ to a basis B in R”, then P is invertible 
and the transition matrix from B to B’ is P™!. 
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Before proving Theorem 4.20, it is necessary to look at and prove a preliminary 
lemma. 


LEMMA 


Let B = {v,, Va». . ., V,} and B’ = {u}, w, . . ., u,} be two bases for a vector 
space V. If 


= Cu + cy +++ + + Cat, 
= Cy Uy + Cyt, t+ + Cal, 


= City + Coty H: eoe + Cant 


nn° n 
then the transition matrix from B to B’ is 
Ci C12 


C21 C22 


Cnt Cm 


PROOF (OF LEMMA) 


Let v = d,v, + d,v, + - - - + d,v,, be an arbitrary vector in V. The coordinate matrix 
of v with respect to the basis B is 
d, 
d 
[v]; á - 


Then you have 


Cy C2 - ++ Ch || d Cyd, + Cyd, +++ + + €,,d, 
lv], = Ca Co Con a, = Coit + Cad oie ee Candy 
Cal Cn2 ares Can d, Cadi + Cody Peest Candy 
On the other hand, 
V=a,V, + dv. Fs os + aN, 
= d (cU; + cat, +> © ++ Gu) + dalc, + cpg + + > + + ct) too + 
+ d (CiU, + Cy, +--+ +,,u,) 
= (dic + dica ++ + + + de,,)y + (dica; + dicn ++ + ++ dpan ++ > 
T (dicn T dcn se est Cnn) By 
which implies 
Cyd, + Cyd, ++ + + + c,d, 
id= Cady + Cagla +--+ Condy l 
Cn + Cmd Ienei Cony 


So, Qlv], = [v]; and you can conclude that Q is the transition matrix from B to B’. a 


PROOF (OF THEOREM 4.20) 


From the preceding lemma, let Q be the transition matrix from B to B’. Then 
[v]; = Plv]; and [v]; = Qlv],, which implies that [v]; = PO[v], for every vector v 
in R”. From this it follows that PQ = J. So, P is invertible and P~! is equal to Q, the 
transition matrix from B to B’. 
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REMARK 


Verify that the transition matrix 
P~ from B to B’ is (B’)~"B. 
Also verify that the transition 
matrix P from B' to B is 

B1B’. You can use these 
relationships to check the 
results obtained by 
Gauss-Jordan elimination. 


Chapter 4 Vector Spaces 


Gauss-Jordan elimination can be used to find the transition matrix P~!. First define 
two matrices B and B’ whose columns correspond to the vectors in B and B’. That is, 


Vil Y2 «+ + Vin 
y. v jus M 
B= 2h 2 2| and B’ = 
Vat VYn2 Van 
Vi Vo Ls 


Then, by reducing the n x 2n matrix [B’ 
place of B’, you obtain the matrix [J, 
formally. 


THEOREM 4.21 
Let 


B = {v}, V>, - 


.., VW} and B’ = {u,,u,. 


Uii Wiz Uin 
Uy, Uz «~~ Udy, 
Uni Ung Unn 
u; u, u, 


B] so that the identity matrix J, occurs in 


P~']. The next theorem states this procedure 


Transition Matrix from B to B’ 


.,U, 


be two bases for R”. Then the transition matrix P~! from B to B’ can be found by 


using Gauss-Jordan elimination on the n x 2n matrix [B’ 


a B] => LPO] 
PROOF 
To begin, let 
Vi = CU, + t, +: + CU, 
V = CU + Coy Fs + + Cyl, 
Va = Cint + C2nll2 +: + Con, 
which implies that 
Uy, uiz Uy, 
Uy) Uy Uy 
Ci). + C5; . eee ‘a 
Uni Ung Unn 
for i= 1,2,...,n. From these vector 
equations 


WyyCqz F UWG Hs ot + Uy Cy; = Vy 


Wy Cz T UC Fe + + E UgyCyi = Vo 


~+tunc 


Uni 1; + Un2C; +: nnĈni T V, 


ni 


fori = 


B], as shown below. 


equations, write the n systems of linear 


1,2,. . ., n. Each of the n systems has the same coefficient matrix, so you can 


reduce all n systems simultaneously using the augmented matrix below. 


Uy, Ui © ~~ Un Vu Via 
Uy; Ugg + + + Un Vo, Yz 
Un Un2 Unn Val Vn2 


Vin 


Applying Gauss-Jordan elimination to this matrix produces 
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DISCOVERY 


1. Let B = {(1, 0), (1, 2)} 
and B’ = {(1, 0), (0, 1)}. 
Form the matrix 
[B’ B]. 


2. Make a conjecture 


about the necessity of 
using Gauss-Jordan 
elimination to obtain 
the transition matrix 
P~ when the change 
of basis is from a 
nonstandard basis to 
a standard basis. 
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te OO. cae “O Gir Cio cae Cry 
O 1 O cy Cx Con 
OQ see L -Ca Cose Cn 


By the lemma following Theorem 4.20, however, the right-hand side of this matrix 
is Q = P~', which implies that the matrix has the form [J P~'], which proves the 
theorem. 


In the next example, you will apply this procedure to the change of basis problem 
from Example 3. 


EXAMPLE 4 Finding a Transition Matrix 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


Find the transition matrix from B to B’ for the bases for R? below. 


B = {(1, 0, 0), (0, 1, 0), (0,0, 1)} and B’ = {(1, 0, 1), (0, — 1, 2), (2, 3, —5)} 


SOLUTION 
First use the vectors in the two bases to form the matrices B and B’. 
1 0 0 1 (0) 2 
B=]|Q0 1 0| and B'=|0 -1 3 
0 0 1 1 2 =5 


Then form the matrix [B’ B] and use Gauss-Jordan elimination to rewrite [B’ B] as 
[z Pl 


1 0 2 1 0 0 1 0 0 =] 4 2 
0. =1 3 0 1 o| => jo 1 0 s 
1 2 =5 0 0 1 0 0 1 I =2 =] 


From this, you can conclude that the transition matrix from B to B’ is 


-1 4 2 
P =| 3 -7 -3|. 
1 -2 -1 


Multiply P~! by the coordinate matrix of x = [1 2 —1]" to see that the result is the 
same as that obtained in Example 3. | 


LINEAR Crystallography is the science of atomic and molecular 
ALGEBRA structure. Ina crystal, atoms are in a repeating pattern 

called a /attice. The simplest repeating unit in a lattice is a 
APPLIED unit cell. Crystallographers can use bases and coordinate 
matrices in FR? to designate the locations of atoms in a 
unit cell. For example, the figure below shows the unit 
cell known as end-centered monoclinic. 


p] 
px 


One possible coordinate matrix for the top end-centered 
. 1 1 T 
(blue) atom is [x], = [5 5 1| ; 


Brazhnykov Andriy/Shutterstock.com 
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TECHNOLOGY 
Many graphing utilities and 
software programs can form 
an augmented matrix and find 
its reduced row-echelon form. 
If you use a graphing utility, 
then you may see something 
similar to the screen below for 
Example 5. 


B 
[£-3 4] 
[2 -2]] 
BPRIME 
CC-1 2 ] 
[2 -211 
aug(BPRIME,B) 
C[C-1 2 -3 4] 
[2 -2 2 -2]] 
rref aug(BPRIME,B) 
CO1 0 -1 2] 
Eo) 1 =2 311 


The Technology Guide at 
CengageBrain.com can help 
you use technology to find a 
transition matrix. 


Note that when B is the standard basis, as in Example 4, the process of changing 
[B’ B]to[Z, P~'] becomes 


B 1) > D, Pl). 


But this is the same process that was used to find inverse matrices in Section 2.3. In 
other words, if B is the standard basis for R”, then the transition matrix from B to B’ is 


Pol = (B'E, Standard basis to nonstandard basis 


The process is even simpler when B’ is the standard basis, because the matrix [B’ B] 
is already in the form 


[n Bl=U, Ph 
In this case, the transition matrix is simply 
P! =B. Nonstandard basis to standard basis 


For instance, the transition matrix in Example 2 from B = {(1, 0), (1, 2)} to 
B' = {(1, 0), (0, 1)} is 


1 1 
-1 — = 
PSIS 3h 


| EXAMPLE Finding a Transition Matrix 


Find the transition matrix from B to B’ for the bases for R? below. 


B = {(—3, 2), (4, —2)} and B’ = {(-1, 2), (2, —2)} 


SOLUTION 


Begin by forming the matrix 


w a|, 2 2 -2l 


and use Gauss-Jordan elimination to obtain the transition matrix P~! from B to B’: 


1 Q -=l 2 
-1] = 
m P] f i =2 A 


So, you have 
=] 2 
P~! = ; 
| 2 d m 
In Example 5, if you had found the transition matrix from B’ to B (rather than from 


B to B’), then you would have obtained 
say 2 [to 4 -1 2 
[8 s1=|-; -2 2 J 
which reduces to 
1 0 3 =2 
Us Pl=[4 1 2 E 


The transition matrix from B’ to B is 


e-h ih 


Verify that this is the inverse of the transition matrix found in Example 5 by multiplying 
PP~' to obtain Z. 
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COORDINATE REPRESENTATION IN GENERAL 
n-DIMENSIONAL SPACES 


One benefit of coordinate representation is that it enables you to represent vectors 
in any n-dimensional space using the same notation used in R”. For instance, in 
Example 6, note that the coordinate matrix of a vector in P, is a vector in R4. 


EXAMPLE 6 Coordinate Representation in P} 


Find the coordinate matrix of 
p=4- 2x + 3x 
relative to the standard basis for P}, 
S = {1, x, x7, 2}. 
SOLUTION 
Write p as a linear combination of the basis vectors (in the given order). 
p = 401) + 0@) + (12) + 3) 
So, the coordinate matrix of p relative to S is 
4 
[pls = = ` 
3 


In the next example, the coordinate matrix of a vector in M, , is a vector in R°. 


EXAMPLE 7 


1| 10/0 
S=4]|0),]|1),10 
0J |O] | 1 
SOLUTION 
X can be written as 
=] 1 0 0 
X= 4] =(-1)/0/} + 4/1] + 3/0 
3 0 0 1 
so the coordinate matrix of X relative to S is 
REMARK Lj 
In Section 6.2 you will learn X] =| 4l. 
more about the use of R” 3 | 


to represent an arbitrary 


n-dimensional vector space. ; ; ; ; 
E j Theorems 4.20 and 4.21 can be generalized to cover arbitrary n-dimensional 


spaces. This text, however, does not cover the generalizations of these theorems. 
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4. 7 Exercises 


See CalcChat.com for worked-out solutions to odd-numbered exercises. 


Finding a Coordinate Matrix In Exercises 1-4, find 
the coordinate matrix of x in R” relative to the standard 
basis. 

1. x = (5, —2) 2x=(1 
3. x = (7, —4, — 1, 2) 4 x= 


$ —3, 0) 


(—6, 12, —4, 9, —8) 


Finding a Coordinate Matrix In Exercises 5-10, given 
the coordinate matrix of x relative to a (nonstandard) 
basis B for R”, find the coordinate matrix of x relative to 
the standard basis. 


5. B = {(2, — 1), (0, 1)}, 6. B={@2,3),G,—2)}, 


iif] x= |~4| 


7. B = {(1,0, 1), (1, 1, 0), (0, 1, 1)}, 


2 


[x] B 7 
1 


8. B= {(3,3,3), (3,4, 4), (756.2), 


2 
[x], E 
4 


9. B = {(0, 0, 0, 1), (0, 0, 1, 1), (0, l; l, 1), (G, 1, 1, 1)}, 


1 

=2 
[x], B 3 
1 


10. 


B = {(4, 0,7, 3), (0, 5, 


( —1, — 1), (—3, 4, 2, 1), 
(0, 1, 5, 0)}, 


Finding a Coordinate Matrix In Exercises 11-16, find 
the coordinate matrix of x in R” relative to the basis B’. 


11. B’ = {(4, 0), (0, 3)}, x = (12, 6) 
12. B’ = {(—5, 6), (3, —2)}, x = (-17, 22) 
13. B’ = {(8, 11, 0), (7, 0, 10), (1, 4, 6)}, x = (3, 19, 2) 


14. B' = = {6.4, 1), ie D 0), (1, zi 2)}, x= (3, -5 8) 
15. B’ = {(4, 3, 3), (— 11,0, 11), (0, 9, 2)}, 
x = (11, 18, —7) 
16. B' = {(9, —3, 15, 4), (3, 0, 0, 1), (0, — 5, 6, 8), 
(3, —4, 2, —3)}, 
x = (0, —20, 7, 15) 


Finding a Transition Matrix In Exercises 17-24, find 
the transition matrix from B to B’. 


17. B = {(1, 0), (0, 1)}, B’ = {(2, 4), (1, 3)} 
18. B = {(1, 0), (0, 1)}, B’ = {(1, 1), (5, 6)} 
19. B = {(2, 4), (—1, 3)}, B’ = {(1, 0), (0, 1)} 
20. B = {(1, 1), (1, 0)}, B’ = {(1, 0), (0, 1)} 


B = {(-1,0, 0), (0, 1, 0), (0, 0, — 1)}, 
B' = {(0, 0, 2), (1, 4, 0), (5, 0, 2)} 


22. B = {(1, 0, 0), (0, 1, 0), (0, 0, 1)}, 
B’ = {(1, 3, — 1), (2, 7, — 4), (2, 9, —7)} 
23. B = {(3, 4, 0), (—2, —1, 1), (1, 0, —3)}, 


B' = {(1, 0, 0), (0, 1, 0), (0, O, 1)} 
B = 4(1, 3, 2), (2, — 1, 2), (5, 6, 1)}, 
B' = {(1, 0, 0), (0, 1, 0), (0, 0, 1)} 


24. 


Ae Finding a Transition Matrix In Exercises 25-36, use 
a software program or a graphing utility to find the 
transition matrix from B to B’. 


25. B = {(2, 5), (1, 2)}, B’ = {(2, 1), (— 1, 2)} 

26. B a 2, 1), (3, 2)}, BY = {(1, 2), (—1, 0)} 

27. B = {(—3, 4), (3, —5)}, B' = {(-5, —6), (7, —8)} 
28. B = {(2, —2),(—2, —2)}, BY = (6, r=3)(=3,=3)] 
29. B = {(1, 0, 0), (0, 1, 0), (0, 0, 1)}, 


B' = {(1, 3, 3), (1, 5, 6), (1, 4, 5)} 
B = {(1, 0, 0), (0, 1, 0), (0, 0, 1)}, 
B' = {(2, -1, 4), (0, 2, 1), (—3, 2, D} 
B = {(1, 2, 4), (-1, 2, 0), (2, 4, 0)}, 
B’ = {(0, 2, 1), (—2, 1, 0), (1, 1, 1)} 
B = {(3, 2, 1), (1, 1, 2), (1, 2, 0)}, 
B' = {(1, 1, — 1), (0, 1, 2), (— 1, 4, 0)} 
B = {(1, 0, 0, 0), (0, 1, 0, 0), (0, 0, 1, 0), (0, 0, 0, 1)}, 
B' = {(1,3,2, — 1), (—2, —5, —5, 4), 

(-1, —2, —2, 4), (—2, —3, — 5, 11)} 
B = {(1, 0, 0, 0), (0, 1, 0, 0), (0, 0, 1, 0), (0, 0, 0, 1)}, 
B' = {(1, 1, 1, 1), (0,1, 1, 1), (0, 0, 1, 1), (0, 0, 0, 1)} 
B = {(1, 0, 0, 0, 0), (0, 1, 0, 0, 0), (0, 0, 1, 0, 0), 

), ( 


©». 


O3. 
O35. 


0 
(0, 0, 0, 1, 0), (0, 0, 0, 0, 1)}, 
B' = {(1,2, 4, —1, 2), (9, —3, 4, 2, 1), 
(0, 1,2, —2, 1), (0, 1, 2, 2, 1), (1, — 1, 0, 1, 2)} 
©) 36. B = {(1, 0, 0, 0, 0), (0, 1, 0, 0, 0), (0, 0, 1, 0, 0), 
(0, 0, 0, 1, 0), (0, 0, 0, 0, 1}, 
B’ = {(2, 4, —2, 1, 0), (3, — 1, 0, 1, 2), (0, 0, —2, 4, 5) 
(2, —1, 2, 1, 1), (0, 1,2, —3, 1)} 
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Finding Transition and Coordinate Matrices 
In Exercises 37—40, (a) find the transition matrix from 
B to B’, (b) find the transition matrix from B’ to B, 
(c) verify that the two transition matrices are inverses of 
each other, and (d) find the coordinate matrix [x],, given 
the coordinate matrix [x],.. 


37. B = {(1, 3), (—2, —2)}, B’ = {(— 12, 0), (—4, 4)}, 


ad 


38. B = {(2, —2), (6, 3)}, B’ = {(1, 1), (32, 31}, 


ke =| | 


39. B = {(1, 0, 2), (0, 1, 3), (1, 1, 1)}, 
B’ = {(2, 1, 1), (1, 0, 0), (0, 2, 1)}, 
1 
[x], = 2 
—1 
40. B = {(1, 1, 1), (1, — 1, 1), (0, 0, 1)}, 
B' = {(2, 2, 0), (0, 1, 1), (1, 0, 1}, 


[x], = 


eS Wh 


Finding Transition and Coordinate Matrices 
In Exercises 41-44, use a software program or a graphing 
utility to (a) find the transition matrix from B to B’, 
(b) find the transition matrix from B’ to B, (c) verify 
that the two transition matrices are inverses of each 
other, and (d) find the coordinate matrix [x], given the 
coordinate matrix [x]; 

41. B = {(4, 2, — 4), (6, —5, — 6), (2, 
B' = {(1, 0, 4), (4, 2, 8), (2, 5, —2)}, 
[x], =i =i 27 

42. B = {(1, 3, 4), (2, —5, 2), (—4, 2, —6)}, 
B' = {(1, 2, —2), (4, 1, —4), (—2, 5, 8)}, 
kl =[-1 0 2f 


1, 8)}, 


43. B = {(2,0, — 1), (0, —1, 3), (1, —3, —2)}, 
B' = {(0, —1, —3), (1, 3, —2), (—3, —2, 0)}, 
[x], =[4 -3 -27 


44. B E {(1, aa 1, 9), (-9, dl, 1), (1, 9, =I}, 
Br = {(3, 0, 3), (~=3, 3, 0), (0, =3, 3)}, 
[xl =[-5 -4 17 
Coordinate Representation in P, In Exercises 45—48, 


find the coordinate matrix of p relative to the standard 
basis for P}. 


45. p = 1 + 5x — 2x? + xX? 46. p = —2 — 3x + 40 
47. p = 13 + 114x + 3x? 
48. p = 4 + 11x +x? + 2x 


4.7 Exercises 217 
Coordinate Representation in M,, In Exercises 
49-52, find the coordinate matrix of X relative to the 
standard basis for M, ,. 


0 2 

49. X =|3 50. X =| -1 
2 

1 1 

51. X = 2 52. X= 0 

=] —4 


53. Writing Is it possible for a transition matrix to equal 
the identity matrix? Explain. 


54. CAPSTONE Let Band B’ be two bases for R”. 


(a) When B = I, write the transition matrix from B to 


n? 


B' in terms of B’. 


(b) When B’ = I, write the transition matrix from B 
to B’ in terms of B. 
(c) When B = I,, write the transition matrix from B’ 


to B in terms of B’. 


(d) When B’ = J, write the transition matrix from B’ 


n? 


to B in terms of B. 


True or False? In Exercises 55 and 56, determine 
whether each statement is true or false. If a statement 
is true, give a reason or cite an appropriate statement 
from the text. If a statement is false, provide an example 
that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


55. (a) If P is the transition matrix from a basis B to B’, then 
the equation P[x],, = [x], represents the change of 
basis from B to B’. 


(b) If B is the standard basis in R”, then the transition 
matrix from B to B’ is P~! = (B’)7!. 

(c) For any 4 x 1 matrix X, the coordinate matrix [X]; 
relative to the standard basis for M, , is equal to X 
itself. 


56. (a) If P is the transition matrix from a basis B’ to B, 
then P~! is the transition matrix from B to B’. 


(b) To perform the change of basis from a nonstandard 
basis B’ to the standard basis B, the transition 
matrix P~! is simply B’. 

(c) The coordinate matrix of p = —3 + x + 5x? relative 
to the standard basis for P, is[ p]; = [5 1 -=3f. 


57. Let P be the transition matrix from B” to B’, and let Q 
be the transition matrix from B’ to B. What is the 
transition matrix from B” to B? 


58. Let P be the transition matrix from B” to B’, and let Q 
be the transition matrix from B’ to B. What is the 
transition matrix from B to B”? 
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4.8 Applications of Vector Spaces 


wi Use the Wronskian to test a set of solutions of a linear 
homogeneous differential equation for linear independence. 


wi Identify and sketch the graph of a conic section and perform a 
rotation of axes. 


LINEAR DIFFERENTIAL EQUATIONS (CALCULUS) 


A linear differential equation of order n is of the form 


y + gay" YD +--+ + giG)y’ + gory =f) 


where go, g8- - -,&,—, and f are functions of x with a common domain. If f(x) = 0, 
then the equation is homogeneous. Otherwise it is nonhomogeneous. A function y is 
a solution of the linear differential equation if the equation is satisfied when y and its 
first n derivatives are substituted into the equation. 


EXAMPLE 1 A Second-Order Linear Differential Equation 


Show that both y = e* and y, = e “are solutions of the second-order linear differential 
equation y” — y = 0. 


SOLUTION 
For the function y} = e*, you have y,’ = e“ and y,” = e*. So, 
yy" -y=er-e#=0 


which means that y, = e* is a solution of the differential equation. Similarly, for 
Yy, = e *, you have 


y, =—-e* and y,” =e™. 
This implies that 
Yo! — Yn =e *—e* = 0. 


So, y, = e™ is also a solution of the linear differential equation. | 


There are two important observations you can make about Example 1. The first is 
that in the vector space C”(— 0, oo) of all twice differentiable functions defined on the 
entire real line, the two solutions y, = e* and y, = e “* are linearly independent. This 
means that the only solution of 

Cy, + Cy, = 0 


that is valid for all x is C, = C, = 0. The second observation is that every linear 
combination of y, and y, is also a solution of the linear differential equation. To see 
this, let y = Ciy, + Cy. Then 

y= Cie + Ge™* 

y = Ce — Ce 

y” = Cie + Cre™. 
Substituting into the differential equation y" — y = 0 produces 

y! — y = (Ce + Ge) = (Cie + Ce) = 0. 


So, y = C,e* + C,e™ is a solution. 
The next theorem, which is stated without proof, generalizes these observations. 
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REMARK 


The solution 


y= Cy, + Cy. +++ ++ Cry, 


is the general solution of the 
differential equation. 


REMARK 


The Wronskian of a set of 

functions is named after the 
Polish mathematician Josef 
Maria Wronski (1778-1853). 


REMARK 


This test does not apply to an 
arbitrary set of functions. Each 
of the functions y}, Yor. . ., 
and y, must be a solution of 
the same linear homogeneous 


differential equation of order n. 
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Solutions of a Linear Homogeneous Differential Equation 


Every nth-order linear homogeneous differential equation 


y + g, sy") +--+ gy + gola)y = 0 


has n linearly independent solutions. Moreover, if {y,, y>,. . -,y,} is a set of 
linearly independent solutions, then every solution is of the form 


y= Cy, + Gy. t+ ++ + Cy, 


where C), Cz, . . ., C, are real numbers. 


In light of the preceding theorem, you can see the importance of being able to 
determine whether a set of solutions is linearly independent. Before describing a way 
of testing for linear independence, consider the definition below. 


Definition of the Wronskian of a Set of Functions 


Let {y,, Y2- - -,¥,} be a set of functions, each of which has n — 1 derivatives 
on an interval J. The determinant 


Wi Ya- . >Yn) = 


yf" = 1) yf = 1) 


is the Wronskian of the set of functions. 


EXAMPLE 2 Finding the Wronskian of a Set of Functions 


a. The Wronskian of the set {1 — x, 1 + x,2 — x}is 
Tex l+x 2-x 


W= -1 1 —1| = 0. 
0 0 0 
b. The Wronskian of the set {x, x7, x°} is 
x r y 


W=]1 2x 3x?) = 2x3. 


0 2 6x | 


The Wronskian in part (a) of Example 2 is identically equal to zero, because it 
is zero for any value of x. The Wronskian in part (b) is not identically equal to zero 
because values of x exist for which this Wronskian is nonzero. 

The next theorem shows how the Wronskian of a set of functions can be used to 
test for linear independence. 


Wronskian Test for Linear Independence 


Let {y,, y>,. . -,,} be a set of n solutions of an nth-order linear homogeneous 


differential equation. This set is linearly independent if and only if the Wronskian 
is not identically equal to zero. 


The proof of this theorem for the case where n = 2 is left as an exercise. (See 
Exercise 40.) 
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Testing a Set of Solutions 
EXAMPLE 3 for iinet Independence 
Determine whether {1, cos x, sin x} is a set of linearly independent solutions of the 
linear homogeneous differential equation 
y +y =0. 
SOLUTION 


Begin by observing that each of the functions is a solution of y” + y’ = 0. (Check 
this.) Next, testing for linear independence produces the Wronskian of the three 
functions, as shown below. 


l cosx sinx 
W= |0 —sinx cosx 
0 —cosx —sinx 
= sin? x + cos? x 
=1 
The Wronskian W is not identically equal to zero, so the set 
{1, cos x, sin x} 


is linearly independent. Moreover, this set consists of three linearly independent 
solutions of a third-order linear homogeneous differential equation, so the general 
solution is 


y= Ci +C, cosx + C, sinx 
where C,, C,, and C; are real numbers. T 
a Testing a Set of Solutions 
EXAMPLE 4 for Linear Independence 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


Determine whether {e*, xe*, (x + 1)e*} is a set of linearly independent solutions of the 
linear homogeneous differential equation 


y" = 3y" + 3y' -y= 0. 
SOLUTION 


As in Example 3, begin by verifying that each of the functions is a solution of 
y” — 3y" + 3y' — y = 0. (This verification is left to you.) Testing for linear 
independence produces the Wronskian of the three functions, as shown below. 
e xe (x + l)e* 
W=le (x+ le (x + 2)e) =0 
e (+e (xt 3)e 


So, the set {e*, xe", (x + 1)e*} is linearly dependent. m 


In Example 4, the Wronskian is used to determine that the set {e*, xe*, (x + l)e*} 
is linearly dependent. Another way to determine the linear dependence of this set is to 
observe that the third function is a linear combination of the first two. That is, 


(x + lev = et + xe. 


Verify that a different set, {e*, xe*, x?e*}, forms a linearly independent set of solutions 
of the differential equation 


y” = 3y" + 3y' -y= 0. 


Copyright 2017 Cengage Learning. All Rights Reserved. May not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eBook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage Learning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


4.8 Applications of Vector Spaces 221 


CONIC SECTIONS AND ROTATION 
Every conic section in the xy-plane has an equation that can be written in the form 
ax? + bxy + cy? + dx + ey + f=0. 


Identifying the graph of this equation is fairly simple as long as b, the coefficient of 
the xy-term, is zero. When b is zero, the conic axes are parallel to the coordinate axes, 
and the identification is accomplished by writing the equation in standard (completed 
square) form. The standard forms of the equations of the four basic conics are given 
in the summary below. For circles, ellipses, and hyperbolas, the point (h, k) is the 
center. For parabolas, the point (h, k) is the vertex. 


Standard Forms of Equations of Conics 
Circle (r = radius): (x — h}? + (y — k}? = r 
Ellipse (2a = major axis length, 28 = minor axis length): 


y Lp -p2 y sahi »— k)2 
N (x a Q = 24 i & v È Q 7 =i 
a B B- a 


Hyperbola (2a = transverse axis length, 28 = conjugate axis length): 


Goh? _O-b? _ | 0-0 _ @=h* | 
B? 


Parabola (p = directed distance from vertex to focus): 


y 
A 


g } p>0 
! Vertex 
| (h, k) 
=)? = 4p -k) p O- k) = 4p- h) 


(h,k) Focus 
(h +p, k) 
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EXAMPLE 5 Identifying Conic Sections 


a. The standard form of x? — 2x + 4y — 3 = Ois 
= 1} = 4(-1)(y = 1). 


The graph of this equation is a parabola with the vertex at (h, k) = (1, 1). The axis 
of the parabola is vertical. The directed distance p from the vertex to the focus is 
p = —1, so the focus is the point (1, 0). Finally, the focus lies below the vertex, so 
the parabola opens downward, as shown in Figure 4.18(a). 


b. The standard form of x? + 4y? + 6x — 8y + 9 = Qis 


(ee Se gee 
e tas Tea 


jip 


The graph of this equation is an ellipse with its center at (h, k) = (—3, 1). The major 
axis is horizontal, and its length is 2a = 4. The length of the minor axis is 28 = 2. 
The vertices of this ellipse occur at (—5, 1) and (— 1, 1), and the endpoints of the 
minor axis occur at (—3, 2) and (—3, 0), as shown in Figure 4.18(b). 


a. b. j 

A 

3+ 

(-3, 2) 
24+ 
1+ 
34 _5 =i 3 Ei =| > xX 
+3 O- D? 
(æ -2:4-0 -D | Ct ,O- Wy 

Figure 4.18 u 


Note that the equations of the conics in Example 5 have no xy-term, so the axes 
of the graphs of these conics are parallel to the coordinate axes. For second-degree 
equations that have an xy-term, the axes of the graphs of the corresponding 
conics are not parallel to the coordinate axes. In such cases, it is helpful to rotate the 
standard axes to form a new x’-axis and y’-axis. The required rotation angle 0 (measured 
counterclockwise) can be found using the equation cot 20 = (a — c)/b. Then, the 
standard basis for R?, 


B = {(1, 0), (0, 1)} 


rotates to form the new basis 
B' = {(cos 0, sin 0), (— sin 0, cos @)} 


as shown below. 


y' 4 (cos 0, sin 0) 
~y (0, 1) i 
(—sin 0, cos 0) je - > ~ ee 
i 6 
+ > d >x 
y N rial 0) 
ae sul oa 


To find the coordinates of a point (x, y) relative to this new basis, you can use a 
transition matrix, as demonstrated in Example 6. 
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EXAMPLE 6 A Transition Matrix for Rotation in R2 


Find the coordinates of a point (x, y) in R? relative to the basis 


B' = {(cos 0, sin @), (— sin 0, cos 6)}. 


SOLUTION 
By Theorem 4.21 you have 


i _|cos@ —sind 1 0 
[8 ae cos 0 0 iI 


B is the standard basis for R?, so P~! is represented by (B’)~!. You can use the formula 
given in Section 2.3 (page 66) for the inverse of a 2 x 2 matrix to find (B’)~!. This 
results in 


Po) = f O0 cos@ sin J 


(0) 1 —sinð cosé@ 


By letting (x’, y') be the coordinates of (x, y) relative to B’, you can use the transition 
matrix P~! as shown below. 


| cos@ sin AN 7 [z] 

—sin@ cos @]Ly y’ 

The x’- and y’-coordinates are x’ = x cos 0 + y sin 0 and y’ = —x sin 0 + y cos 0. m 
The last two equations in Example 6 give the x’y’-coordinates in terms of the 

xy-coordinates. To perform a rotation of axes for a general second-degree equation, it is 


helpful to express the xy-coordinates in terms of the x'y’-coordinates. To do this, solve 
the last two equations in Example 6 for x and y to obtain 


x=x'cos@—y'sin@ and y=x'sin@ + y’ cos ð. 


Substituting these expressions for x and y into the given second-degree equation 
produces a second-degree equation in x’ and y’ that has no x’y’-term. 


Rotation of Axes 


The general second-degree equation ax? + bxy + cy? + dx + ey + f = Ocanbe 
written in the form 


a'(x')? + c'(y')? + d'y + ey’ +f’ =0 


by rotating the coordinate axes counterclockwise through the angle 0, where 0 is 


i : a-c or f 
found using the equation cot 20 = Ea The coefficients of the new equation 


are obtained from the substitutions 


x= x' cos — y' sin and y= x sin@ + y' cos ð. 


The proof of the above result is left to you. (See Exercise 80.) 


LINEAR A satellite dish is an antenna that is designed to transmit 
ALGEBRA signals to or receive signals from a communications satellite. 
A standard satellite dish consists of a bowl-shaped surface 
APPLIED and a feed horn that is aimed toward the surface. The 
bowl-shaped surface is typically in the shape of a rotated 
elliptic paraboloid. (See Section 7.4.) The cross section of the 
surface is typically in the shape of a rotated parabola. 


Chris H. Galbraith/Shutterstock.com 
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Example 7 demonstrates how to identify the graph of a second-degree equation by 
rotating the coordinate axes. 


EXAMPLE 7 Rotation of a Conic Section 


Perform a rotation of axes to eliminate the xy-term in 


5x2 — 6xy + 5y? + 14,/2x — 2 /2y + 18 = 0 


and sketch the graph of the resulting equation in the x’y’-plane. 


SOLUTION 
Find the angle of rotation 0 using 
cot 29 = = =.: 0. 


b =6 
This implies that 0 = 7/4. So, 
sin 0 = as and cos @ = En 
ae nea 


By substituting 


1 


(x' +3)? (y= 12 x = x' cos 0 — y' sin 0 = —=(’ — y’) 
eg ee v2 
, 7 and 
Y, a P i 
Š „1 y = x' sin 0 + y' cos 0 = —=(x' + y’) 
‘it g 
CVO 0=45° sia 
= eoo ee into the original equation and simplifying, verify that you obtain 
E (x')? +y P + 6x’ — 8y' +9 =0. 
[ar 5> Finally, by completing the square, the standard form of this equation is 
EN ~2,/2) ae | (a + 3) + (y' -17 = @’ + 3) + (y' = =1 
a“ -4 F 2? 1? 4 1 
Figure 4.19 which is the equation of an ellipse, as shown in Figure 4.19. a 


In Example 7, the new (rotated) basis for R? is 


* aah eva) 


and the coordinates of the vertices of the ellipse relative to B’ are 


— -1 
| | and | il 
To find the coordinates of the vertices relative to the standard basis 


B = {(1, 0), (0, 1)}, use the equations 
1 


/2 


x œ -= y’) 
and 


y= wre +y’) 


to obtain (-3 J2; -2/2) and (- J2, 0), as shown in Figure 4.19. 
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4. 8 Exercises See CalcChat.com for worked-out solutions to odd-numbered exercises. ie 
— [m] 


Determining Solutions of a Differential Equation 
In Exercises 1-12, determine which functions are 
solutions of the linear differential equation. 


ly +y=0 

(a) e (b) sin x 

(c) cos x (d) sinx — cos x 
2. y” +y=0 

(a) e (b) e* (c) e” (d) 2e™* 
3. y” +y" +y +y=0 

(a) x (b) e* (c) e~* (d) xe~* 
4. y" — 6y' + 9v = 0 

(a) e* (b) xe3* 

(c) xe” (d) (x + 3)e% 
5. y® +y” —2y"=0 

(a) 1 (b) x (c) x? (d) æ 
6. y — 16y = 0 

(a) 3 cos x (b) 3 cos 2x 

(c) e7% (d) 3e% — 4 sin 2x 


7. xy" — 2y =0 


1 2 2 

(a) 2 (b) x? (c) e (d) e* 
8. y + (2x — lly = 0 

(a) ev» (b) 2e*-* (e) 3e? (d) 47? 
9. xy’ — 2y =0 

(a) /x (b) x (c) x (d) x? 
10. xy’ + 2y’ =0 

(a) x (b) i (c) xe* (d) xe~* 
11. y” — y'— 12y=0 

(a) e+ (b) ew (c) e7? (d) ex 
12. y' — 2xy = 0 

(a) 3e% (b) xe? (c) 2e (d) xe™* 


Finding the Wronskian for a Set of Functions 
In Exercises 13-26, find the Wronskian for the set of 
functions. 


13. {x, — sin x} 14. {e%™, sin 2x} 

15. {e*, e*} 16. fe’, e77} 

17. {x, sin x, cos x} 18. {x, —sin x, cos x} 
19. {e-*, xe*, (x + 3)e*} 20. {x, e*, e°} 

21. {1, e*, e*} 22. {x?, e°, xe} 

23. {1, x, x”, x*} 24. {x, x”, e”, e*} 

25. {1, x, cos x, e~*} 26. {x, e*, sin x, cos x} 


4.8 Exercises 225 
[m] 


Showing Linear Independence In Exercises 27-30, 
show that the set of solutions of a second-order linear 
homogeneous differential equation is linearly independent. 


27. {e%, e}, a #b 28. {e%, xe} 
29. {cos ax, sin ax}, a # 0 
30. {e cos bx, e sin bx}, b # 0 


Testing for Linear Independence In Exercises 31-38, 

(a) verify that each solution satisfies the differential 

equation, (b) test the set of solutions for linear 

independence, and (c) if the set is linearly independent, 

then write the general solution of the differential equation. 
Differential Equation Solutions 

31. y” + loy =0 

32. y" — 4y' + 5y = 0 

33. y” + 4y" + 4y’ =0 

34. y” + 4y’ =0 

35. y” + 4y' = 0 {1, sin 2x, cos 2x} 

36. y” + 3y" + 3y’ +y=0 {e™*, xe ™*, xe *} 

37. y” + 3y" + 3y'+y=0 {e-*, xe, e™* + xe} 

38. y — 2" + y"=0 {1, x, e*, xe*} 


{sin 4x, cos 4x} 

{e** sin x, e™ cos x} 

{e72*, xe72*, (2x + 1)e72*} 
{1, 2 cos 2x, 2 + cos 2x} 


39. Pendulum Consider a pendulum of length L that 
swings by the force of gravity only. 


For small values of 0 = (t), the motion of the pendulum 
can be approximated by the differential equation 


where g is the acceleration due to gravity. 
(a) Verify that 


: § E 
A ok 
s i cos/2 


is a set of linearly independent solutions of the 
differential equation. 

(b) Find the general solution of the differential equation 
and show that it can be written in the form 


oA =A cof $e + J 
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40. Proof Let {y,,y,} be a set of solutions of a 
second-order linear homogeneous differential equation. 
Prove that this set is linearly independent if and only if 
the Wronskian is not identically equal to zero. 


41. Writing Is the sum of two solutions of a 
nonhomogeneous linear differential equation also a 
solution? Explain. 


42. Writing Is the scalar multiple of a solution of a 
nonhomogeneous linear differential equation also a 
solution? Explain. 


Identifying and Graphing a Conic Section 
In Exercises 43-58, identify and sketch the graph of the 
conic section. 
43. y +x=0 44, x? — 6y =0 
45. x° + 4y? — 16=0 46. 5x? + 3y? — 15 =0 
x 2 ; 
i= pa ee a gt 
49. X2 + 4x + 6y-2=0 50. y — 6y— 4x + 21=0 
51. 16x? + 36y? — 64x — 36y + 73 = 0 
52. 4x7 + y2 — 84 +3 =0 
53. 9x? — y? + 54x + 10y + 55 = 0 
54. 4y? — 2x? — 4y — 8&x — 15 = 0 
55. x? + 4y? + 4x + 32y + 64 =0 
56. 4y? + 4x? — 24x + 35 =0 
57. 2x2 — y? + 4x + 10y — 22 =0 
58. y2 + 8x + 6y + 25 =0 


Matching a Graph with an Equation In Exercises 
59-62, match the graph with its equation. [The graphs 
are labeled (a), (b), (c), and (d).] 
(a) aA (b) 
nA 


59. xy + 2=0 

60. —2x? + 3xy + 22 +3 =0 
61. x? — xy +3 -5=0 

62. x? — 4xy + 4y* + 10x — 30 = 0 


Rotation of a Conic Section In Exercises 63-74, 
perform a rotation of axes to eliminate the xy-term, and 
sketch the graph of the conic. 


63. xy + 1=0 64. xy — 8x — 4y = 0 
65. 4x2 + 2xy + 4y7 —- 15 =0 

66. x2 + 2xy + y? — 8x + By = 0 

67. 2x7 — 3xy — 22 + 10 = 0 

68. 5x? — 2xy + 5y? — 24 = 0 

69. 9x? + 24xy + 16y? + 90x — 130y = 0 

70. 5x2 — 6xy + 5y — 12 = 0 

71. 7x2 — 6./3xy + 13y? — 64 = 0 

72. 7x2 — 2./3xy + 5y? = 16 

73. 3x2 — 2./3xy + y2 + 2x + 2.\3y =0 

74. x2 + 2./3xy + 3y — 2/3x + 2y + 16=0 
Rotation of a Degenerate Conic Section In Exercises 


75-78, perform a rotation of axes to eliminate the 
xy-term, and sketch the graph of the “degenerate” conic. 


75. x° — Ixy +y =0 76. 5x? — 2xy + 5y = 0 
77. xX + 2xy + y? — 1 = 0 78. x? — 10xy +y = 0 


79. Proof Prove that a rotation of 0 = 7/4 will eliminate 
the xy-term from the equation 
ax? + bxy + ay? + dx + ey + f= 0. 

80. Proof Prove that a rotation of 0, where 
cot 20 = (a — c)/b, will eliminate the xy-term from 
the equation 
ax? + bxy + cy? + dx + ey + f= 0. 

81. Proof For the equation ax? + bxy + cy? = 0, define 
the matrix A as 


a b/2 
A= ; 
pa c | 
(a) Prove that if |A| =0, then the graph of 
ax? + bxy + cy? = 0 is a line. 
(b) Prove that if |A| #0, then the graph of 
ax? + bxy + cy* = 0 is two intersecting lines. 


82. CAPSTONE 


(a) Explain how to use the Wronskian to test a set 
of solutions of a linear homogeneous differential 


equation for linear independence. 


(b) Explain how to eliminate the xy-term when it 
appears in the general equation of a conic section. 


83. Use your school’s library, the Internet, or some other 
reference source to find real-life applications of 
(a) linear differential equations and (b) rotation of conic 
sections that are different than those discussed in this 
section. 
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Review Exercises 227 


Vector Operations In Exercises 1-4, find (a) u + v, 
(b) 2v, (c) u — v, and (d) 3u — 2v. 


1. u = (1, —2, —3), v= (3, 1,0) 

2.u=(-1,2,1), v= (0,1,1) 

3. u = (3, — 1,2,3), v = (0,2,2,1) 

4. u = (0,1, —1,2), v = (1,0,0, 2) 
Solving a Vector Equation In Exercises 5-8, solve for 
x, where u = (1, —1, 2), v = (0, 2, 3), and w = (0, 1, 1). 
5.2x-u+3v+w=0 6. 3x +2u-—v+2w=0 
7. Su — 2x =3v+w 8. 3u + 2x =w-v 


Writing a Linear Combination In Exercises 9-12, write 
v as a linear combination of u,, u,, and u,, if possible. 


9. v= (3, 0, —6), u = (i, =i; 2), u = (2, 4, =2), 
u; = (1; 2, —4) 
10. 5 (4, 4, 5), u = (1, 2; 3), u, = (=2, 0, 1), 
u; = (1, 0, 0) 
11. v = (1,2, 3,5), u, = (1,2, 3,4), 
u, = (—1, —2, —3, 4), u = (0,0, 1, 1) 
12. v = (4,-13,-5,-4), u, = (1, -2, 1, 1), 
u, = (-1,2,3,2), w = (0,-1,-1, -1) 


Describing the Zero Vector and the Additive Inverse 
In Exercises 13-16, describe the zero vector and the 
additive inverse of a vector in the vector space. 


13. M4» 14. P; 
15. R5 16. M3; 


Determining Subspaces In Exercises 17-24, determine 
whether W is a subspace of the vector space V. 


17. W = {(x, y): x = 2y}, V= R 

18. W = {(x, y: x- y=1}, V=R 

19. W = {(x, y): y = ax, a is an integer}, V = R? 
20. W = {(x, y): y = ax}, V= R? 

21. W = {(x, 2x, 3x): x is a real number}, V = R3 
22. W = {(x, y, z): x 2 OF, V= R 

23. W={f:f@ = -1}, v= c[-1,1] 

24. W = {f: f(-—1) = 0}, v= c[-1,1] 


25. Which of the subsets of R? is a subspace of R°? 
(a) W = {(x,, X» x3): x7 + x2 + x3 = 0} 
(b) W = {(x X x3): x7 + x2 + x3 = I} 

26. Which of the subsets of R° is a subspace of R?? 
(a) W = {(x,, X>, x3): x, + x, + x, = 0} 
(b) W = {(x,, X» x3): x, + x, + x3 = 1} 


Spanning Sets, Linear Independence, and Bases 
In Exercises 27-32, determine whether the set (a) spans 
R?, (b) is linearly independent, and (c) is a basis for R?. 


27. S = {(1, —5, 4), (11, 6, — 1), (2, 3, 5)} 

28. S = {(4, 0, 1), (0, — 3, 2), (5, 10, 0)} 

29. S = {(—5,3, -1), (5, 2, 3), (-4, 6, —8)} 

30. S = {(2, 0, 1), (2, — 1, 1), (4, 2, 0)} 

31. S = {(1, 0,0), (0, 1, 0), (0, 0, 1), (—1, 2, —3)} 
32. S = {(1, 0, 0), (0, 1, 0), (0, 0, 1), (2, — 1, 0)} 


33. Determine whether 
S = {1 — t, 2t + 37,2? — 2P,2+ P} 


is a basis for P}. 
34. Determine whether S$ = {1, t, 1 + £} is a basis for P}. 


Determining Whether a Set Is a Basis In Exercises 
35 and 36, determine whether the set is a basis for M, ,. 


sel? 12 IL I 
x IC IE I D 


Finding the Nullspace, Nullity, and Rank of a Matrix 
In Exercises 37-42, find (a) the nullspace, (b) the nullity, 
and (c) the rank of the matrix A. Then verify that 
rank(A) + nullity(A) = n, where n is the number of 
columns of A. 


37. iel sl 


12 -9 
1 4 
waft 4] 
2 -3 -6 -4 
39. A=/1 5 -3 11 
2 7 -6 16 
1 0 -2 0 
40. A=| 4 -2 4 -2 
-2 0 1 3 
il 3 2 
4 -1 -18 
Acia a AG 
1 2 0 
Io gn 2 
1 4 0 3 
macia s o 2 
1 2 6 1 
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Finding a Basis for a Row Space and Rank In Exercises 
43-46, find (a) a basis for the row space and (b) the rank 
of the matrix. 


1 2 2 =1 4 
43. | —4 3 44. |1 5 6 
6 1 1 16 14 
T 0 2 1 2 
45. + 1 6 46. | —1 4 1 
—1 16 14 0 1 


Finding a Basis and Dimension In Exercises 47-50, 
find (a) a basis for and (b) the dimension of the solution 
space of the homogeneous system of linear equations. 
47. 2x, + 4x, + 3x, — 6x, = 0 

x, + 2x, + 2x, - Sx, = 0 

3x, + 6x, + 5x; — 11x, = 0 
48. 16x, + 24x, + 8x, — 32x, = 0 

4x, + 6x, + 2x, — 8x, =0 

2x, + 3x, + x,- 4x, =0 


© 49. x, -3n4+ n+ x, =0 


2x, + X,— xX, + 2x,=0 
x, + 4x, — 2x, + x, =0 
5x, — 8x, + 2x, + 5x, = 0 
=y tn = ty + 2x, = 0 
—2x, + 2x, + x, + 4x, =0 
3x, + 2x, + 2x, + 5x, =0 
—3x, + 8x, + 5x, + 17x, = 0 
Finding a Coordinate Matrix In Exercises 51-56, given 
the coordinate matrix of x relative to a (nonstandard) 


basis B for R”, find the coordinate matrix of x relative to 
the standard basis. 


51.B={0,1),(-L UD} k] =B 5F 
52. B = {(2, 0), (3,3)}, Bh BO 1F 
53. B= {6}. 0 kbb F 
54. B = {(2,4),(-1,)} Bk] = [4 -7F 
55. B = {(1, 0, 0), (1, 1, 0), (0, 1, 1)}, 
Ix],=[2 0 -1f 
56. B = {(1, 0, 1), (0, 1, 0), (0,1, D}, [x], =[4 0 2F 
Finding a Coordinate Matrix In Exercises 57-62, find 
the coordinate matrix of x in R” relative to the basis B’. 
57. B’ = {(5, 0), (0, —8)}, x = (2,2) 
58. B’ = {(2, 2), (0, —1)}, x = (-1,2) 
59. B’ = {(1, 2, 3), (1, 2, 0), (0, —6, 2)}, x = (3, —3, 0) 
60. B’ = {(1, 0, 0), (0, 1, 0), (1, 1, 1)}, x = (4, —2, 9) 
61. B’ = {(9, —3, 15, 4), (—3, 0, 0, — 1), (0, —5, 6, 8), 
(—3, 4, —2,3)}, x = (21, —5, 43, 14) 
62. B’ = {(1, —1, 2, 1), (1, 1, —4, 3), (1, 2, 0, 3), 
(1,2, —2,0)}, x = (5, 3, —6, 2) 


Finding a Transition Matrix In Exercises 63-68, find 
the transition matrix from B to B’. 


63. B ={(1,—-1), 3,1}, BY = {(1,0), (0, )} 
64. B ={(1,-1),3,)}, BY = {(1,2), (-1,0)} 
65. B = {(1, 0, 0), (0, 1, 0), (0, 0, 1)}, 

B' = {(0, 0, 1), (0, 1, 0), (1, 0, 0)} 
66. B = I1; l; 1), (1, ils 0), (1, 0, 0)}, 

B' = {(1, 2, 3), (0, 1, 0), (1,0, D} 
67. B = {(1, 1, 2), (2, 3, 4), (3, 3, 3)}, 

B' = {(7, ll; 1), ( 3, 1, 0), (-3, 0, 1)} 
68. B = {(1, 1, 1), (3, 4, 3), (3, 3, 4)}, 

B' = {(1, -1,3), (-2, 1, 0), (1, 0, —4)} 


Finding Transition and Coordinate Matrices 
In Exercises 69-72, (a) find the transition matrix from 
B to B’, (b) find the transition matrix from B’ to B, 
(c) verify that the two transition matrices are inverses 
of each other, and (d) find the coordinate matrix [x],,, 
given the coordinate matrix [x]. 


69. B = {(—2, 1), (1, —1)}, B’ = {(0, 2), (1, 1)}, 
kh =[6 -6f 

70. B = {(1,0), 0,- D} B’ = {0 1), 0, = 1D}, 
kh= B2 -2f 

71. B = {(1,0, 0), (1, 1, 0), (1, 1, 1)}, 
B' = {(0, 0, 1), (0, 1, 1), (1, 1, 1)}, 
Ix], =[-1 2 -3F 

72. B = {(1, 1, —1), (1, 1, 0), (1, — 1, 0)}, 
B' = {(1, —1, 2), (2,2, — 1), (2, 2, 2)}, 
kh =B 2 -1f 


73. Let W be the subspace of P, [the set of all polynomials 
p(x) of degree 3 or less] such that p(0) = 0, and let U be 
the subspace of P, such that p(1) = 0. Find a basis for W, 
a basis for U, and a basis for their intersection W N U. 

74. Calculus Let V = C'(— oo, c0), the vector space of 
all continuously differentiable functions on the real line. 
(a) Prove that W = {f: f’ = 4f} is a subspace of V. 
(b) Prove that U = {f: f’ =f + 1} is not a subspace 

of V. 

75. Writing Let B = {p,(x), px). -> Pa), Pra} 
be a basis for P,. Must B contain a polynomial of each 
degree 0, 1,2,. . ., n? Explain. 

76. Proof Let A and B be n x n square matrices with 
A # O and B # O. Prove that if A is symmetric and B 
is skew-symmetric (BT = — B), then {A, B} is a linearly 
independent set. 

77. Proof Let V = P, and consider the set W of all 
polynomials of the form (x3 + x)p(x), where p(x) is in 
P,. Is W a subspace of V? Prove your answer. 
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78. Let v,, V, and v, be three linearly independent 
vectors in a vector space V. Is the set 
{v, — 2v,, 2V, — 3v3, 3V3 — v,} linearly dependent or 
linearly independent? Explain. 

79. Proof Let A be ann x n square matrix. Prove that the 
row vectors of A are linearly dependent if and only if 
the column vectors of A are linearly dependent. 


80. Proof Let A be ann x n square matrix, and let A be a 
scalar. Prove that the set 
S = {x: Ax = Ax} 
is a subspace of R”. Determine the dimension of S when 
A = 3 and 


3 1 0 
A={|0 3 0 
0 0 1 


81. Let f(x) = x and g(x) = |x]. 
(a) Show that f and g are linearly independent in 
C[-1, 1}. 
(b) Show that f and g are linearly dependent in C[0, 1]. 


82. Describe how the domain of a set of functions can 
influence whether the set is linearly independent or 
dependent. 


True or False? In Exercises 83-86, determine whether 
each statement is true or false. If a statement is true, give 
a reason or cite an appropriate statement from the text. 
If a statement is false, provide an example that shows the 
statement is not true in all cases or cite an appropriate 
statement from the text. 


83. (a) The standard operations in R” are vector addition 
and scalar multiplication. 


(b) The additive inverse of a vector is not unique. 


(c) A vector space consists of four entities: a set of 
vectors, a set of scalars, and two operations. 
84. (a) The set W = {(0, x?, x3): x? and x3 are real numbers} 
is a subspace of R°. 
(b) A set of vectors S in a vector space V is a basis for 
V when S spans V and S is linearly independent. 
(c) If A is an invertible n x n matrix, then the n row 
vectors of A are linearly dependent. 
85. (a) The set of all n-tuples is n-space and is denoted 
by R”. 
(b) The additive identity of a vector space is not unique. 
(c) Once a theorem has been proved for an abstract 
vector space, you need not give separate proofs for 
n-tuples, matrices, and polynomials. 
86. (a) The set of points on the line x +y=0 is a 
subspace of R?. 
(b) Elementary row operations preserve the column 
space of the matrix A. 
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Determining Solutions of a Differential Equation 
In Exercises 87-90, determine which functions are 
solutions of the linear differential equation. 


87. y’— y- 6y =0 


(a) e% (b) e% (c) e > (d) e7% 
88. y2 -y =0 

(a) e (b) e™* (c) cos x (d) sin x 
89. yy + 2y=0 

(a) e~>* (b) xe7~?* (c) x*e7* (d) 2xe7>* 


90. y” + 25y = 0 
(a) sin 5x + cos 5x (b) 5sinx + 5cosx 


(c) sin 5x (d) cos 5x 


Finding the Wronskian for a Set of Functions 
In Exercises 91-94, find the Wronskian for the set of 
functions. 

91. {1, x, e*} 

93. {1, sin 2x, cos 2x} 


92. {2, x2,3 + x} 


94. {x, sin? x, cos? x} 


Testing for Linear Independence In Exercises 95-98, 
(a) verify that each solution satisfies the differential 
equation, (b) test the set of solutions for linear 
independence, and (c) if the set is linearly independent, 
then write the general solution of the differential 
equation. 


Differential Equation Solutions 
95. y + 6y’ + 9y =0 {e—3, xe 3} 
96. y" a 6y' eh 9y =0 fe, 3e} 


97. y” — 6y" + lly’ — 6y =0 
98. y! + 9y =0 


le, e%, e — e>} 


{sin 3x, cos 3x} 


Identifying and Graphing a Conic Section 
In Exercises 99-106, identify and sketch the graph of the 
conic section. 


99. X2 + y? + 4x —- 2y—- 11 =0 

100. 9x? + 9y? + 18x — 18y + 14=0 
101. x7 — y+ 2x -3=0 

102. 4x7 — y? + 8x -6y + 4=0 

103. 2x7 — 20x — y+ 46 =0 

104. y — 4x -4=0 

105. 4x7 + y2 + 32x + 4y + 63 =0 
106. 16x? + 25y? — 32x — 50y + 16 = 0 


Rotation of a Conic Section In Exercises 107-110, 
perform a rotation of axes to eliminate the xy-term, and 
sketch the graph of the conic. 


107. xy = 3 

108. 9x? + 4xy + 9y? — 20 = 0 

109. 16x? — 24xy + 9y? — 60x — 80y + 100 = 0 
110. x2 + 2xy + y2 + J/2x -— /2y =0 
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4 Projects 


1 Solutions of Linear Systems 


Write a paragraph to answer the question. Do not perform any calculations, but 
instead base your explanations on appropriate properties from the text. 


1. One solution of the homogeneous linear system 
OG chee Vaca e a SW) =) 
eS + w=0 
V= g ar 2v=0 
isx = —2,y = —1,z = 1, and w = 1. Explain why x = 4, y = 2,z = —2, and 
w = —2 is also a solution. 


2. The vectors x, and x, are solutions of the homogeneous linear system Ax = 0. 
Explain why the vector 2x, — 3x, is also a solution. 


3. Consider the two systems represented by the augmented matrices. 


1 1p =5 3 1 ees a9 
1 O =2 1 1 0) =2,°=3 
22 E] 0 2 e= ee 0 


If the first system is consistent, then why is the second system also consistent? 


4. The vectors x, and x, are solutions of the linear system Ax = b. Is the vector 
2x, — 3x, also a solution? Why or why not? 


5. The linear systems Ax = b, and Ax = b, are consistent. Is the system 
Ax = b, + b, necessarily consistent? Why or why not? 


2 Direct Sum 


In this project, you will explore the sum and direct sum of subspaces. In Exercise 
58 in Section 4.3, you proved that for two subspaces U and W of a vector space V, 
the sum U + W of the subspaces, defined as U + W = {u + w: u E U, w E€ W}, is 
also a subspace of V. 


1. Consider the subspaces of V = R? below. 
D—NGy, x ER 
W = {(x, 0, x): x € R} 
Z (eee) Ean 
Find U + W, U + Z, and W + Z. 


2. If U and W are subspaces of V such that V = U + W and UN W = {0}, then 
prove that every vector in V has a unique representation of the formu + w, where 
u is in U and wis in W. V is called the direct sum of U and W, and is written as 


V=UOW. Direct sum 
Which of the sums in part (1) are direct sums? 

3. Let V= U®W, and let {u,,u,,. . .,u,} be a basis for the subspace U 
and {w,,W>,. ..,W,,} be a basis for the subspace W. Prove that the set 
{iss r, Up Wa.) 2 Wp is a basis for V. 


4. Consider the subspaces U = {(x, 0, y): x, y E R} and W = {(0, x, y): x, y E R} of 
V = R. Show that R? = U + W. Is R? the direct sum of U and W? What are the 
dimensions of U, W, U N W, and U + W? Formulate a conjecture that relates the 
dimensions of U, W, U N W, and U + W. 


5. Do there exist two two-dimensional subspaces of R? whose intersection is the 
zero vector? Why or why not? 


East/Shutterstock.com 
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Clockwise from top left, Jezper/Shutterstock.com; Lisa F. Young/Shutterstock.com; 23 1 
iStockphoto.com/kupicoo; Andrea Danti/Shutterstock.com; Sebastian Kaulitzki/Shutterstock.com 


Copyright 2017 Cengage Learning. All Rights Reserved. May not be copied, scanned, o nine cated, in wh ole or in part. Due to electronic rights, some third party content may be suppressed from the eBook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage Learning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


232 Chapter 5 Inner Product Spaces 


5.1 Length and Dot Product in R” 


(V1, V9) 


= 2 2 
Iw = Jitu 


Figure 5.1 


>N 


Find the length of a vector and find a unit vector. 
Find the distance between two vectors. 


Find a dot product and the angle between two vectors, determine 
orthogonality, and verify the Cauchy-Schwarz Inequality, the triangle 
inequality, and the Pythagorean Theorem. 


J Use a matrix product to represent a dot product. 


VECTOR LENGTH AND UNIT VECTORS 


Section 4.1 mentioned that vectors can be characterized by two quantities, length and 
direction. This section defines these and other geometric properties (such as distance 
and angle) of vectors in R”. Section 5.2 extends these ideas to general vector spaces. 

You will begin by reviewing the definition of the length of a vector in R?. If 
v = (v,, v2) is a vector in R?, then the length, or norm, of v, denoted by ||v||, is the length 
of the hypotenuse of a right triangle whose legs have lengths of |v,| and |v,|, as shown in 
Figure 5.1. Applying the Pythagorean Theorem produces 


IMP = [vy]? + [vp]? = vt + v5 
lvl = vt + v3 


Using R? as a model, the length of a vector in R” is defined below. 


Definition of the Length of a Vector in R” 


The length, or norm, of a vector v = (v;, V», . . ., v,) in R” is 


lv] = Wve t+ ve +--+ 


The length of a vector is also called its magnitude. If ||v|| = 1, then the vector v 
is a unit vector. 


This definition shows that the length of a vector cannot be negative. That is, 
\|v|| = 0. Moreover, ||v|| = 0 if and only if v is the zero vector 0. 


EXAMPLE 1 The Length of a Vector in R” 


a. In R5, the length of v = (0, —2, 1, 4, — 2) is 
Wi = /0? + (—2)? + 1? + 47 + (-2) = /25 = 5. 
b. In R, the length of v = (2/ /17, —2//17, 3/17) is 
IM = Vle7Jt7y + (-2/ VTF + G/T? = VTT = 1. 


The length of v is 1, so v is a unit vector, as shown in Figure 5.2. m 


Each vector in the standard basis for R” has length 1 and is a standard unit vector 
in R”. It is common to denote the standard unit vectors in R? and R? as 


{i, j} = {(1, 0), (0, 1)} and {i, j, k} = {(1, 0, 0), (O, 1, 0), (0, 0, 1)}. 


Two nonzero vectors u and v in R” are parallel when one is a scalar multiple of 
the other—that is, u = cv. Moreover, if c > 0, then u and v have the same direction, 
andifc < 0, then u and v have opposite directions. The next theorem gives a formula 
for finding the length of a scalar multiple of a vector. 
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TECHNOLOGY 


You can use a graphing utility 
or software program to find 
the length of a vector v, the 
length of a scalar multiple cv 
of a vector, or a unit vector in 
the direction of v. For instance, 
if you use a graphing utility to 
verify the result of Example 2, 
then you may see something 
similar to the screen below. 


VECTOR: V 3 


unitV V 
C.8018 -.2673 .5345] 


Note that = = 0.8018, 


/14 
1 
——= ~ —0.2673, and 
14 a 
2 
—— = 0.5345. 
/14 


See LarsonLinearAlgebra.com 
for an interactive example. 


Figure 5.3 
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THEOREM 5.1 Length of a Scalar Multiple 


Let v be a vector in R” and let c be a scalar. Then 


lev = [el Iv 


where |c| is the absolute value of c. 


PROOF 
cv = (cv, CVa, . . . , CV), SO it follows that 
levl| = |l(ev,, cv». -~> evp) 
= Sev? + lev, +--+ (ev, 
= |e Vv? + v2 +--+ v2 


= Je] |l. m 


One important use of Theorem 5.1 is in finding a unit vector having the same 
direction as a given vector. Theorem 5.2 provides a procedure for doing this. 


THEOREM 5.2 Unit Vector in the Direction of v 


If v is a nonzero vector in R”, then the vector 


ees 
M 


has length 1 and has the same direction as v. This vector u is the unit vector in 
the direction of v. 


PROOF 


v # 0, so you know that ||v|| # 0. You also know that 1/||v|| is positive, so you can write 
u as a positive scalar multiple of v. 


u= (a) 


It follows that u has the same direction as v, and u has length 1 because 


v 1 
lull = | 


= vi = 1. 
ml ~ mw" al 


The process of finding the unit vector in the direction of v is called normalizing 
the vector v. The next example demonstrates this procedure. 


ESTUE Finding a Unit Vector 


Find the unit vector in the direction of v = (3, — 1, 2), and verify that this vector has 
length 1. 


SOLUTION 


The unit vector in the direction of v is 
v_ G12) (3, -1,2)=(4 a2! 2) 
Wi ECP Ja lia JAF i4 


which is a unit vector because 


MGa CRG) - VB = erens: 
Jia Ji Jia = 4 . (See Figure 5.3.) | 


Copyright 2017 Cengage Learning. All Rights Reserved. May not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eBook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage Learning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


234 Chapter 5 Inner Product Spaces 


DISTANCE BETWEEN TWO VECTORS IN A” 


To define the distance between two vectors in R”, R? will be used as a model. The 
Distance Formula from analytic geometry states that the distance d between two points 
in R?, (u, uz) and (vj, v5), is 

d= Vu, = v) + (u = v) 
In vector terminology, this distance can be viewed as the length of u — v, where 


u = (u,, u,) and v = (v4, v), as shown below. That is, 


la = vl = V&, = v? + Ge = v,)?. 


i, v2) 


Olga Taussky-Todd 
A 0001095) d(u, v) = |lu - vil = u = vı)? + (u — v2)? 

Taussky-Todd was born 
in what is now the Czech This leads to the next definition. 
Republic. She became 
interested in mathematics 
at an early age. During 
her life, Taussky-Todd 
was a distinguished and 
prolific mathematician. 
She wrote many research 
papers in such areas as 


matrix theory, group 
theory, algebraic number Verify the three properties of distance listed below. 


Definition of Distance Between Two Vectors 


The distance between two vectors u and v in R” is 


d(u, v) = |lu — vll. 


theory, and numerical 

analysis. Taussky-Todd 1. d(u, v) = 0 

received many honors and 2. d(u, v) = 0 if and only if u = v. 
distinctions for her work. 

For example, her paper 3. d(u, v) = d(v, u) 

on the sum of squares 


algae the Pond Prize EXAMPLE 3 Finding the Distance Between Two Vectors 
o oE 
Math tical be 3 
ee Ba a. The distance between u = (— 1, —4) and v = (2, 3) is 
ia d(u, v) = |lu — v|| = |(—1 — 2, -4 — 3) = V(-3? + (7? = V58. 
b. The distance between u = (0, 2, 2) and v = (2, 0, 1) is 
dlu, v) = |lu — v|| = (0 — 2,2 — 0,2 — D| = V(—2)2 + 2? + 12 = 3. 


c. The distance between u = (3, — 1, 0, — 3) and v = (4, 0, 1, 2) is 


Association Le 
of America. 


d(u, v) = |ju — vl] 
=|G=4:=1 =00-1,-3—9)] 
= f(=1)? + (1? + (1? + (= 5P 
= /28 
= 2T: T 


photos provided by Jacobs, Konrad/Oberwolfach Photo Collection 
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REMARK 


Notice that the dot product 
of two vectors is a scalar, 
not a vector. 


TECHNOLOGY 


You can use a graphing utility 
or software program to find 
the dot product of two vectors. 
If you use a graphing utility, 
then you may verify Example 4 
as shown below. 


VECTOR:U 4 
e1=1 
e2=2 
e3=0 
e4=-3 
VECTOR:V 4 
e1=3 
e2=-2 
e3=4 
e4=2 
dot (U,V) 7 


The Technology Guide at 
CengageBrain.com can help 
you use technology to find a 
dot product. 
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DOT PRODUCT AND THE ANGLE BETWEEN TWO VECTORS 


To find the angle 0 (0 < @ < 7) between two nonzero 
vectors u = (u, u) and v = (v,, v5) in R?, apply the Law 
of Cosines to the triangle shown to obtain 


full 


lly — ul? = lla? + [vP — 2u] llv] cos 6. 
Expanding and solving for cos @ yields 
Angle Between Two Vectors 


cos @ = 41 AY = "avo 
llull lvl 


The numerator of the quotient above is the dot product of u and v and is denoted by 
Ue V = uV + Uva. 


The definition below generalizes the dot product to R”. 


Definition of Dot Product in R” 


The dot product ofu = (u,, u5,. . ., u,,) and v = (v,, v,,. . ., v,) is the scalar 


quantity 


u. v = uy + Uv, t: 


EXAMPLE 4 Finding the Dot Product of Two Vectors 


The dot product of u = (1, 2, 0, — 3) and v = (3, —2, 4, 2) is 
u + v = (1)(3) + (2)(—2) + (0)(4) + (—3)(2) = -7. | 


THEOREM 5.3 Properties of the Dot Product 


If u, v, and w are vectors in R” and c is a scalar, then the properties listed below 
are true. 


~-UurvVrTve7u 


-ur(vt+tw)=urvtu-ew 

. c(u* v) = (cu) + v =u: (cv) 
vev = |v 

.v•e v = 0,andv -° v = 0 if and only if v = 0. 


PROOF 


The proofs of these properties follow from the definition of dot product. For example, 
to prove the first property, write 


U. V= UV + UNV ++ + + + U,V, 


= VU, + Vol, ++ + + + VU, 


=v°-u. ul 


In Section 4.1, R” was defined to be the set of all ordered n-tuples of real numbers. 
When R” is combined with the standard operations of vector addition, scalar 
multiplication, vector length, and the dot product, the resulting vector space is 
Euclidean n-space. In the remainder of this text, unless stated otherwise, assume that 
R” has the standard Euclidean operations. 
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EXAMPLE 5 Finding Dot Products 

Let u = (2, —2), v = (5, 8), and w = (—4, 3). Find each quantity. 
a u.v 

b. (u ° v)w 

c. u + (2v) 

d. ||w|/? 
e. u ° (v — 2w) 
SOLUTION 


a. By definition, you have 


uv = 2(5) + (—2)(8) = —6. 


b. Using the result in part (a), you have 

(u * v)w = —6w = —6(—4, 3) = (24, — 18). 
c. By Property 3 of Theorem 5.3, you have 

u • (2v) = 2(u ° v) = 2(—6) = —12. 
d. By Property 4 of Theorem 5.3, you have 

IWP = w+ w = (—4)(—4) + (3)(3) = 25. 
e. 2w = (—8, 6), so you have 


v — 2w = (5 — (—8), 8 — 6) = (13, 2). 


Consequently, 
u» (v — 2w) = 2(13) + (-2)(2) = 26 - 4 = 22. T 
EXAMPLE 6 Using Properties of the Dot Product 
Consider two vectors u and v in R” such that u * u = 39, u ° v = —3, and v ° v = 79. 
Evaluate (u + 2v) + (3u + v). 
SOLUTION 


Using Theorem 5.3, rewrite the dot product as 


DISCOVE RY (u + 2v) * (3u + v) =u (3u + v) + (2v) > (Bu + v) 


1. Let u = (1, 1) and = u ° (3u) + u + v + (2v) ° (3u) + (2v)°v 
v = (—4, —3). Calculate = 3(u-u) + u ° v + 6(v • u) + 2(v ° v) 
u » v and ||ul] ivi]. = 3(u-u) + 7(u ° v) + 2(v ° v) 

2. Repeat with other = 3(39) + 7(—3) + 2(79) 


choices for u and v. 


= 254. a 


To define the angle 0 between two nonzero vectors u and v in R”, use the formula 


3. Formulate a conjecture 
about the relationship 
between the dot in R2 
product of two vectors 
and the product of their s= , 
lengths. luli [Iv 


u.’ yv 


For such a definition to make sense, however, the absolute value of the right-hand 
side of this formula cannot exceed 1. This fact comes from a famous theorem named 
after the French mathematician Augustin-Louis Cauchy (1789-1857) and the German 
mathematician Hermann Schwarz (1843-1921). 
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THEOREM 5.4 The Cauchy-Schwarz Inequality 


If u and v are vectors in R”, then 


lu + v| = [full [lvl 


where |u + v| denotes the absolute value of u + v. 


PROOF 
Case 1. If u = 0, then it follows that |u + v| = |0 + v| = 0 and |ul|||v|| = Oļlv|| = 0. So, 
the theorem is true when u = 0. 
Case 2. When u # 0. let ¢ be any real number and consider the vector tu + v. The 
product (tu + v) + (tu + v) is nonnegative, so it follows that 

(tu + v)» (tu + v) = f(u-u) + 2e¢u-v) +vev= 0. 


Now, let a= u »* u, b = 2(u* v), and c = v • v to obtain the quadratic inequality 
at + bt +c = 0. This quadratic is never negative, so it has either no real roots 
or a single repeated real root. But by the Quadratic Formula, this implies that the 
discriminant, b* — 4ac, is less than or equal to zero. 


b? — 4ac < 0 
b? < 4ac 
4(u + v}? < 4(u- u)(v • v) 
(u + v}? < (u + uv v) 
Taking the square roots of both sides produces 


hessas = [hl a 


EXAMPLE 7 Verifying the Cauchy-Schwarz Inequality 


Verify the Cauchy-Schwarz Inequality for u = (1, — 1, 3) and v = (2, 0, — 1). 


IA IA IA 


IA 


SOLUTION 

usv=-—l,u-u= 1l, and v • v = 5, so you have 
jue v| =|-1| =1 

and 


lulllvi| = Jusuyvev 
= i<f 11/5 
= a55: 


The inequality |u + v| < |lull ||v|| holds, because 1 < \/55. | 


The Cauchy-Schwarz Inequality allows the definition of the angle between two 
nonzero vectors to be extended to R”. 


REMARK Definition of the Angle Between Two Vectors in R” 
The angle between the zero 
vector and another vector is The angle 0 between two nonzero vectors in R” can be found using 
not defined. 


u.v 


cos 0 = , OS OET. 
ful} |v 
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REMARK 


Even though the angle 
between the zero vector 
and another vector is not 
defined, it is convenient to 
extend the definition of 
orthogonality to include the 
zero vector. In other words, 
the vector 0 is said to be 
orthogonal to every vector. 


Figure 5.4 


EXAMPLE 8 Finding the Angle Between Two Vectors 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


The angle between u = (—4, 0, 2, — 2) and v = (2, 0, — 1, 1) is 
oe ee —12 -L 12 DESS 
lall] = 24/6 14 


Consequently, 0 = z. It makes sense that u and v should have opposite directions, 
because u = — 2v. | 


Note that ||u|| and ||v|| are always positive, so u + v and cos 0 will always have the 
same sign. Moreover, the cosine is positive in the first quadrant and negative in the second 
quadrant, so the sign of the dot product of two vectors can be used to determine, for 
instance, whether the angle between them is acute or obtuse. 


Opposite Obtuse angle Right angle Acute angle Same 
direction u-v <0 u-v=0 u-v>0 direction 
0 
8 u 0 u 
u 0 u 
— 

u v v v v v 
=r Z<0<T g-2 0<0<5 0=0 
cos 0 = -1 “ 2 cos 0=1 


Note from the above that two nonzero vectors meet at a right angle if and only if 
their dot product is zero. Two such vectors are orthogonal (or perpendicular). 


Definition of Orthogonal Vectors 


Two vectors u and v in R” are orthogonal when 


u-v=0. 


EXAMPLE 9 Orthogonal Vectors in R” 


a. The vectors u = (1, 0, 0) and v = (0, 1, 0) are orthogonal because 
u + v = (1)(0) + (0)(1) + (0)(0) = 0. 
b. The vectors u = (3, 2, — 1, 4) and v = (1, — 1, 1, 0) are orthogonal because 


uv = (3)(1) + 2)(-1) + (= D0) + (40) = 0. Lal 


EXAMPLE 10 Finding Orthogonal Vectors 


Determine all vectors in R? that are orthogonal to u = (4, 2). 


SOLUTION 


Let v = (v,, v2) be orthogonal to u. Then 


u. v = (4,2) + (v, v) = 4, + 2v, =0 


which implies that 2v, = — 4v, and v, = —2v,. So, every vector that is orthogonal to 
(4, 2) is of the form 


v = (t, —2¢ = x1, —2) 


where f is a real number. (See Figure 5.4.) T| 
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lu + vi] < [lull + Iivi] 


Figure 5.5 


REMARK 


Equality occurs in the triangle 
inequality if and only if the 
vectors u and v have the same 
direction. (See Exercise 86.) 


Figure 5.6 
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The Cauchy-Schwarz Inequality can be used to prove another well-known 
inequality called the triangle inequality (Theorem 5.5 below). The name “triangle 
inequality” is derived from the interpretation of the theorem in R?, illustrated for the 
vectors u and v in Figure 5.5(a). When you consider 


lul ana |v 
to be the lengths of two sides of a triangle, the length of the third side is 
u + vll. 


Moreover, the length of any side of a triangle cannot be greater than the sum of the 
lengths of the other two sides, so you have 


la + vil < [full + fvl. 


Figure 5.5(b) illustrates the triangle inequality for the vectors u and v in R°. The 
theorem below generalizes these results to R”. 


THEOREM 5.5 The Triangle Inequality 


If u and v are vectors in R”, then 


la + vil < [lull + fvl. 


PROOF 
Using the properties of the dot product, you have 
ju + vi? = (u + v) + (u + v) 
=u-(u+v)t+v-(u+y) 
=u-u+2(u-ev)tvev 
= ul? + 2(u > v) + |v] 
ul? + 2|u + v| + |Iv|. 


IA 


Now, by the Cauchy-Schwarz Inequality, |, and 


u + v| = [ul] 


IA 


ju + vie < lull? + 2|u + v| + Ivl 
ul? + 2hhulllvi| + Ivi 

(lall + [Iv1)°. 

Both |u + v|| and (|lul| + ||v||) are nonnegative, so taking the square roots of both sides 
yields 


lu + vl] < [ull + Ivl m 


IA 
ER 


From the proof of the triangle inequality, you have 
lu + v|? = llu? + 2(u + v) + |iv]P. 


If u and v are orthogonal, then u • v = 0, and you have the extension of the 
Pythagorean Theorem to R”, shown below. 


THEOREM 5.6 The Pythagorean Theorem 


If u and v are vectors in R”, then u and v are orthogonal if and only if 


la + vP = lal? + Ivi- 


Figure 5.6 illustrates this relationship graphically for R? and R°. 
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Chapter 5 


Inner Product Spaces 


THE DOT PRODUCT AND MATRIX MULTIPLICATION 


It is often useful to represent a vector in R” as ann x 1 column matrix. In this notation, 
the dot product of two vectors 


uy vy 
u v 
u=|?| ad ¥=| > 
Un Va 


can be represented as the matrix product of the transpose of u multiplied by v. 
Vy 


u-v=uv=[u, u... u] "2 = [uv] + uv, +--+ + u,v, ] 


Using Matrix Multiplication 
EXAMPLE 11 to Find Dot Products 


a. The dot product of the vectors 


"ED 


NTEN oj$] = [(2)(3) + (0)(1)] = 6. 


b. The dot product of the vectors 


1 3 

u= 2| and v=]ļ|-2 
—1 4 

3 


isu- v = u'y = [1 2 —-1] -2| = (D3) + Q)(-2) + (-D@] = —-5. 


4 La 


Many of the properties of the dot product are direct consequences of the 
corresponding properties of matrix multiplication. In Exercise 87, you are asked to use 
the properties of matrix multiplication to prove the first three properties of Theorem 5.3. 


LINEAR Electrical engineers can use the dot product to calculate 

ALGEBRA electric or magnetic flux, which is a measure of the 
strength of the electric or magnetic field penetrating a 

APPLIED surface. Consider an arbitrarily shaped surface with an 
element of area dA, normal (perpendicular) vector dA, 
electric field vector E, and magnetic field vector B. The 
electric flux ®, can be found using the surface integral 
®, = JE+ dA and the magnetic flux ®,, can be found 
using the surface integral ©,, = [B+ dA. It is interesting to 
note that for a closed surface that surrounds an electrical 
charge, the net electric flux is proportional to the charge, 
but the net magnetic flux is zero. This is because electric 
fields initiate at positive charges and terminate at negative 
charges, but magnetic fields form closed loops, so they do 
not initiate or terminate at any point. This means that the 
magnetic field entering a closed surface must equal the 
magnetic field leaving the closed surface. 


Awe Inspiring Images/Shutterstock.com 
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See CalcChat.com for worked-out solutions to odd-numbered exercises. 


Finding the Length of a Vector In Exercises 1-4, find Ae Finding Lengths, Unit Vectors, and Dot Products 


the length of the vector. 
1. v = (4, 3) 
3. v = (5, —3, —4) 


2. v = (0, 1) 
4. v = (2,0, —5, 5) 


Finding the Length of a Vector In Exercises 5-8, find 
(a) llull, (b) |Iv||, and (c) |[u + vll. 


5.u=(-1,4), v=(4,-3) 
6. u = (1,5), v = (2, -3) 
7. u = (3,1,3), v=(0,—-1,1) 


8. u = (0, 1,12) v=(1, 1, 3, 0) 


Finding a Unit Vector In Exercises 9-12, find a unit 

vector (a) in the direction of u and (b) in the direction 

opposite that of u. Verify that each vector has length 1. 
9. u = (—5, 12) 10. u = (2, — 2) 

11. u = (3, 2, —5) 12. u = (— 1,3, 4) 


Finding a Vector In Exercises 13-16, find the vector v 
with the given length and the same direction as u. 


13. |54 u=(,1) 14 |v] =4, u= (=1,1) 
15. |v = 5, u=(J5,5,0) 
16. ||v| = 3, u = (0,2, 1, —1) 


17. Consider the vector v = (— 1, 3, 0, 4). Find u such that 
(a) u has the same direction as v and one-half its length. 


(b) u has the direction opposite that of v and twice its 
length. 


18. For what values of c is ||c(1, 2, 3)|] = 1? 


Finding the Distance Between Two Vectors In 
Exercises 19-22, find the distance between u and v. 


19. u = (1,—1), v=(-1,1) 

20. u = (—1,2,5), v= (3,0, —1) 

21. u = (1,2,0), v=(-1,4,1) 

22. u = (0,1, -1,2), v= (1,1,2,2) 

Finding Dot Products In Exercises 23-26, find 
(a) u + v, (b) v • v, (c) |lul?, (d) (u - v)v, and (e) u = (5v). 
23. u = (3,4), v = (2, —3) 

24. u = (-1,2), v = (2, —2) 

25. u = (2, —2, 1), v= (2,—1, —6) 

26. u = (4,0, —3, 5), v = (0,2, 5,4) 


27. Find (u + v) • (2u — v) when u * u = 4, u ¢ v = —5, 
and v ° v = 10. 

28. Find (3u — v) + (u — 3v) when u °- u = 8,u ° v = 7, 
andv: v= 6. 


In Exercises 29-34, use a software program or a graphing 
utility to find (a) the lengths of u and v, (b) a unit vector 
in the direction of v, (c) a unit vector in the direction 
opposite that of u, (d) u ° v, (e) u + u, and (f) v > v. 


29. u= (1553) v = (0,45) 

30. u=(—1,3,4), v= (0,4, -3) 

31. u = (0,1, ¥2), v=(-1, /2,-1) 

32. u = (-1, V3, 2), ene be 

33. u narra =(=2, 2,3, =) 
= (1, 


/2, -1, 2), m 


Verifying the Cauchy-Schwarz Inequality In 
Exercises 35-38, verify the Cauchy-Schwarz Inequality 
for the vectors. 


35. u = (6, 8), 
36. u = (—1,0), v= (1,1) 

37. u = (1,1, —2), v= (1, -3, —2) 
38. u = (1, —1,0), v= (0,1, —1) 


34. u 


Finding the Angle Between Two Vectors In Exercises 
39-46, find the angle 0 between the vectors. 


39. u = (3,1), v = (—2,4) 

40. u = (—4, 1), v= (5,0) 

41. u = (cos iN sin z), v= (cos am sin 3x) 
6 6 4 4 

42. u = (cos - sin z), v= (cos A sin z) 

43. u = (1,1,1), v= (2,1, —1) 

44. u = (2,3,1), v = (—3,2,0) 

45. u = (0, 1,0, 1), v = (3,3,3,3) 

46. u = (1, —1,0,1), v = (-1,2, -1,0) 


Determining a Relationship Between Two Vectors 
In Exercises 47-54, determine whether u and v are 
orthogonal, parallel, or neither. 


47. u = (2,18), v = (3, -2) 
48. u = (4,3), v= (4, -3 
49. u = (-3,3), v= (2, -4) 


50. u = (1,—1), v=(0,-1) 

51. u = (0,1,0), v= (1, —2, 0) 

52. u = (0,3, —4), v= (1, -8, -6) 
53. u = (—2,5, 1,0), v = (} — 0.1) 


54. u = (4,3,-1,4), v= (-2,-3,4,-}) 
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Finding Orthogonal Vectors In Exercises 55-58, 
determine all vectors v that are orthogonal to u. 


55. u = (0,5) 56. u = (11, 2) 
57. u = (2, —1, 1) 58. u = (4, —1, 0) 


Verifying the Triangle Inequality In Exercises 59-62, 
verify the triangle inequality for the vectors u and v. 


59. u = (4,0), v=(1,1) 60. u = (—1,1), v = (2,0) 
61. u = (1,1, D, v= (0,1, -2) 
62. u = (1, —1,0), v = (0,1,2) 


Verifying the Pythagorean Theorem In Exercises 
63—66, verify the Pythagorean Theorem for the vectors 
u and v. 


63. u=(1,-1), v= (1,1) 
64. u = (3, —2), v = (4,6) 
65. u = (3,4, —2), v= (4, —3,0) 
66. u = (4,1, —5), v = (2, —3, 1) 


67. Rework Exercise 23 using matrix multiplication. 
68. Rework Exercise 24 using matrix multiplication. 
69. Rework Exercise 25 using matrix multiplication. 


70. Rework Exercise 26 using matrix multiplication. 


Writing In Exercises 71 and 72, determine whether the 
vectors are orthogonal, parallel, or neither. Explain. 


71. u = (cos 6, sin 0, — 1), v = (sin 8, — cos 0, 0) 
72. u = (—sin 9, cos 0, 1), v = (sin 0, — cos 90, 0) 


True or False? In Exercises 73 and 74, determine 
whether each statement is true or false. If a statement 
is true, give a reason or cite an appropriate statement 
from the text. If a statement is false, provide an example 
that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


73. (a) The length or norm of a vector is 

vl] = |v, tv, +v +-+ 

(b) The dot product of two vectors u and v is another 
vector represented by 


al 


U e V = (U,V, UVa, U3V3, >. Upp) 


74. (a) If v is a nonzero vector in R”, then the unit vector in 
the direction of v is u = ||v\|/v. 


(b) If u* v < 0, then the angle 0 between u and v 
is acute. 


Writing In Exercises 75 and 76, explain why each 
expression involving dot product(s) is meaningless. 
Assume that u and v are vectors in R”, and that c is 
a scalar. 


75. (a) (ue v) —v 
76. (a) (ue v)°eu 


(b) u + (u. v) 
(b) c» (ue v) 


Orthogonal Vectors In Exercises 77 and 78, let 
v = (v,,¥,) be a vector in R?. Show that (v,, —v,) is 
orthogonal to v, and use this fact to find two unit vectors 
orthogonal to the given vector. 


77. v = (12,5) 78. v = (8, 15) 


79. Revenue The vector u = (3140, 2750) gives the 
numbers of hamburgers and hot dogs, respectively, 
sold at a fast-food stand in one month. The vector 
v = (2.25, 1.75) gives the prices (in dollars) of the food 
items. Find the dot product u ° v and interpret the result 
in the context of the problem. 


80. Revenue The vector u = (4600, 4290, 5250) gives 
the numbers of units of three models of cellular phones 
manufactured. The vector v = (499.99, 199.99, 99.99) 
gives the prices in dollars of the three models of cellular 
phones, respectively. Find the dot product u + v and 
interpret the result in the context of the problem. 


81. Find the angle between the diagonal of a cube and one 
of its edges. 

82. Find the angle between the diagonal of a cube and the 
diagonal of one of its sides. 


83. Guided Proof Prove that if u is orthogonal to v and w, 
then u is orthogonal to cv + dw for any scalars c and d. 


Getting Started: To prove that u is orthogonal to 

cv + dw, you need to show that the dot product of u 

and cv + dwis 0. 

(i) Rewrite the dot product of u and cv + dw as a 
linear combination of (u + v) and (u + w) using 
Properties 2 and 3 of Theorem 5.3. 

(ii) Use the fact that u is orthogonal to v and w, and the 
result of part (i), to lead to the conclusion that u is 
orthogonal to cv + dw. 

84. Proof Prove that if u and v are vectors in R”, then 
1 1 

u+ v = a + vP — flu — vie. 

85. Proof Prove that the vectors u = (cos 6, — sin 0) and 

v = (sin 0, cos 0) are orthogonal unit vectors for any 

value of 0. Graph u and v for 0 = 7/3. 


86. Proof Prove that |lu + v|| = |lul| + |[v|| if and only if u 
and v have the same direction. 


87. Proof Use the properties of matrix multiplication to 
prove the first three properties of Theorem 5.3. 


88. CAPSTONE What do you know about 0, the 
angle between two nonzero vectors u and v, under 


each condition? 


(a)urcv=0 (b)urv>0 (c)urev<0 


89. Writing Letxbeasolution to the m x n homogeneous 
linear system of equations Ax = 0. Explain why x is 
orthogonal to the row vectors of A. 
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5.2 Inner Product Spaces 


Determine whether a function defines an inner product, and find 
the inner product of two vectors in R”, M,, ,, Par and Cla, b]. 


Find an orthogonal projection of a vector onto another vector in 
an inner product space. 


INNER PRODUCTS 


In Section 5.1, the concepts of length, distance, and angle were extended from R? to R”. 
This section extends these concepts one step further—to general vector spaces—by 
using the idea of an inner product of two vectors. 

You are already familiar with one example of an inner product: the dot product in 
R”. The dot product, called the Euclidean inner product, is only one of several inner 
products that can be defined on R”. To distinguish between the standard inner product 
and other possible inner products, use the notation below. 


u ° v = dot product (Euclidean inner product for R”) 

(u, v) = general inner product for a vector space V 

A general inner product is defined in much the same way that a general vector 
space is defined—that is, in order for a function to qualify as an inner product, it must 


satisfy a set of axioms. The axioms below parallel Properties 1, 2, 3, and 5 of the dot 
product given in Theorem 5.3. 


Definition of Inner Product 


Let u, v, and w be vectors in a vector space V, and let c be any scalar. An inner 
product on V is a function that associates a real number (u, v) with each pair of 
vectors u and v and satisfies the axioms listed below. 


1. (u, v) = (v, u) 

2. (u, v + w) = (u, v) + (u, w) 

3. clu, v) = (cu, v) 

4. (v, v) = 0, and (v, v) = 0 if and only if v = 0. 


A vector space V with an inner product is an inner product space. Whenever 
an inner product space is referred to, assume that the set of scalars is the set of real 
numbers. 


EXAMPLE 1 The Euclidean Inner Product for R” 


Show that the dot product in R” satisfies the four axioms of an inner product. 


SOLUTION 
In R”, the dot product of two vectors u = (u4, up, . . ., u,) and V = (vi, Vas. . .,v,) iS 
U’ VS UV E UNV ++ + H U,V, 


By Theorem 5.3, you know that this dot product satisfies the required four axioms, 
which verifies that it is an inner product on R”. 


The Euclidean inner product is not the only inner product that can be defined on 
R”. Example 2 illustrates a different inner product. To show that a function is an inner 
product, you must show that it satisfies the four inner product axioms. 
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EXAMPLE 2 A Different Inner Product for R2 


Show that the function below defines an inner product on R?, where u = (u,, u,) and 
v = (vp v2). 


(u, v) = uv; + 2u, 
SOLUTION 
1. The product of real numbers is commutative, so 
(u, v) = u,v, + 2u,v, = vyu, + 2v,u, = (v, u). 
2. Let w = (w,, w,) Then 
(u, v + w) = u,(v, + w,) + 2u,(v, + wp) 
= u,v, + uw, + 2u,v, + 2u,W, 
= (u,v, + 2u,v,) + (uw; + 2u,w,) 
= (u, v) + (u, w). 
3. If c is any scalar, then 
clu, v) = c(u,v, + 2u5v5) = (cu,)v, + 2(cu,)v. = (cu, v). 
4. The square of a real number is nonnegative, so 
(v, Vv) = vi + 2v3 = 0. 
Moreover, this expression is equal to zero if and only if v = 0 (that is, if and only if 
v = v = 0). | 
Example 2 can be generalized. The function 
(U,V) = CMV, + CollyVy +++ + Cyl Vay C; > O 


is an inner product on R”. (In Exercise 89, you are asked to prove this.) The positive 
constants c,,. . ., c, are weights. If any c; is negative or 0, then this function does not 
define an inner product. 


EXAMPLE 3 A Function That Is Not an Inner Product 


Show that the function below is not an inner product on R°, where u = (u,, u), u3) and 
v = (Vj, Vp, V3). 


(u, v) = u,v, — 2u V7 + UV; 


SOLUTION 
Observe that Axiom 4 is not satisfied. For example, let v = (1,2, 1). Then 
(v, v) = (1)(1) — 2(2)(2) + (1)(1) = —6, which is less than zero. | 


EXAMPLE 4 An Inner Product on M, , 


a a b b : ; 
Let A = | i d and B = | i | be matrices in the vector space M, 5. 
ai An bı bn 


The function 
(A, B) = iibi F dibi + Agby, + azb 


is an inner product on M, ,. The verification of the four inner product axioms is left to 
you. (See Exercise 27.) | 
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REMARK 


Remember that a and b must 
be distinct, otherwise 


b 
Í f(x)g(x) dx 


is zero regardless of which 
functions fand g you use. 
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You obtain the inner product in the next example from calculus. The verification of 
the inner product properties depends on the properties of the definite integral. 


eE] An Inner Product Defined by 
EXAMPLE 5 a Definite Integral (Calculus) 
Let f and g be real-valued continuous functions in the vector space C[a, b]. Show that 


t= f a 


defines an inner product on C[a, b]. 


SOLUTION 


Use familiar properties from calculus to verify the four parts of the definition. 


1. (f2) = f TE f als)fla) de = (ef) 
2 (f.g + h) = i flLels) + Ha)] ax = i LOSES OOL 


= froo dx + [ room dx = (f, 8) + (fh) 


3. (fig) =c f fogl) dx = f cf(x)g(x) dx = (cf, 8) 


V 


4. [f(x)F = 0 for all x, so you know from calculus that 
b 
‘Lip = f [f(x)P dx = 0 
with 
b 
P= f [f(x)P dx = 0 
if and only if f is the zero function in C[a, b]. m 


The next theorem lists some properties of inner products. 


THEOREM 5.7 Properties of Inner Products 


Let u, v, and w be vectors in an inner product space V, and let c be any real 
number. 


1. (0, v) = (v, 0) = 0 
2. (u + v, w) = (u, w) + (v, w) 
3. (u, cv) = clu, v) 


PROOF 


The proof of the first property is given here. The proofs of the other two properties are 
left as exercises. (See Exercises 91 and 92.) From the definition of an inner product, 
you know (0, v) = (v, 0), so you only need to show one of these to be zero. Using the 
fact that O(v) = 0, 


(0, v) = (O(v), v) 
= Ov, v) 


=0. | 
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The definitions of length (or norm), distance, and angle for general inner product 
spaces closely parallel those for Euclidean n-space. 


Definitions of Length, Distance, and Angle 


Let u and v be vectors in an inner product space V. 


1. The length (or norm) of u is ||ul| = <u, u). 
2. The distance between u and v is d(u, v) = |lu — vll. 


3. The angle between two nonzero vectors u and v can be found using 


onan 0O<O<n. 
[full llv] 


4. u and v are orthogonal when (u, v) = 0. 


If |u| = 1, then u is a unit vector. Moreover, if v is any nonzero vector in an inner 
product space V, then the vector u = v/||v|| is the unit vector in the direction of v. 
Note that the definition of the angle 0 between u and v presumes that 


(u,v) _ 
lall 


for a general inner product (as with Euclidean n-space), which follows from the 
Cauchy-Schwarz Inequality given later in Theorem 5.8. 


SI Finding Inner Products 


For polynomials p = ap + ax +: -+ a,x" and q = bọ +t bx t: -+ b,x” 
in the vector space P,, the function (p,q) = aobo + ajb; +: + + + a,b, is an 
inner product. (In Exercise 34, you are asked to show this.) Let p(x) = 1 — 2x?, 
g(x) = 4 — 2x + x?, and r(x) = x + 2x? be polynomials in P,, and find each quantity. 


a. (p,q) b. (qr) |lgl|_ d. dp, q) 
SOLUTION 
a. The inner product of p and q is 
(p, q) = aobo + aib; + ab, = (1)(4) + (0)(—2) + (—2)(1) = 2. 


b. The inner product of q and r is (q, r) = (4)(0) + (—2)(1) + (1)(2) = 0. 
Notice that the vectors g and r are orthogonal. 


c. The length of q is |lq| = 4q, g) = /4 + (2P + P = V21. 


-l< 


d. The distance between p and q is 
d(p, 4) = |p — all 
= |(1 - 2x2) - (4 - 2x + 2) 
= ||-3 + 2x — 3x?|| 
= (3P + 2 (-3F 


= J2. m 


Orthogonality depends on the inner product. That is, two vectors may be orthogonal 
with respect to one inner product but not to another. Rework parts (a) and (b) of 
Example 6 using the inner product (p, q} = dgby + a,b, + 2a,b,. With this inner 
product, p and q are orthogonal, but q and r are not. 
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TECHNOLOGY 


Many graphing utilities and 
software programs can 
approximate definite integrals. 
For instance, if you use a 
graphing utility, then you 

may verify Example 7(b) as 
shown below. 


VC fnInt ((x-x2)2,x,0,1 
2) 
- 182574185835 


The result should be 


approximately 0.183 =~ a 


/30 
The Technology Guide at 
CengageBrain.com can help 
you use technology to 


approximate a definite integral. 
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EXAMPLE 7 Using the Inner Product on C[0, 1] (Calculus) 


Use the inner product defined in Example 5 and the functions f(x) = x and g(x) = x 
in C[0, 1] to find each quantity. 


fll b. dg) 
SOLUTION 


a. f(x) = x, so you have 


Ie = (A) = i ()(a) ae = | eee Epa) 


0 


2 


a. 


So, 


l= 
b. To find d(f, g), write 
la P = F= ef 8) 


= Í [œ — g(x) Pdx = Í [x — xF dx 


er XK z| 1 


1 
= es Dy exe. + 
fe x3 + x4] dx E 7 5 


ee 
So, df, 8) = Tag wi 


In Example 7, the distance between the functions f(x) = x and g(x) = x? in 


C[O, 1] is 1/ /30 ~ 0.183. In practice, the distance between a pair of vectors is not as 
useful as the relative distance(s) between more than one pair. For example, the distance 
between g(x) = x? and h(x) = x? + 1 in C[O, 1] is 1. (Verify this.) From the figures 
below, it seems reasonable to say that f and g are closer than g and h. 


y y 
A A 


| L 
1 
t > X A t > xX 


2 1 2 
d(h, g)=1 


The properties of length and distance listed for R” in the preceding section also 
hold for general inner product spaces. For instance, if u and v are vectors in an inner 
product space, then the properties listed below are true. 


Properties of Length Properties of Distance 


1. ul = 0 1. d(u, v) = 0 
2. |lul| = 0 if and only if u = 0. 2. d(u, v) = 0 if and only if u = v. 
3. ||cul| = |c] llul] 3. d(u, v) = d(v, u) 
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Theorem 5.8 lists the general inner product space versions of the Cauchy-Schwarz 
Inequality, the triangle inequality, and the Pythagorean Theorem. 


THEOREM 5.8 


Let u and v be vectors in an inner product space V. 


1. Cauchy-Schwarz Inequality: |(u, v)| < [ul] ||v/| 


2. Triangle inequality: |u + v|| < |lul] + |lvl| 
3. Pythagorean Theorem: u and v are orthogonal if and only if 


la + vi? = lal? + Ivi. 


The proof of each part of Theorem 5.8 parallels the proofs of Theorems 5.4, 5.5, 
and 5.6, respectively. Simply substitute (u, v} for the Euclidean inner product u + v in 
each proof. 


g “ej An Example of the Cauchy-Schwarz 
EXAMPLE 8 Inequality (Calculus) 
Let f(x) = 1 and g(x) = x be functions in the vector space C[0, 1], with the inner 
product defined in Example 5. Verify that |( f, g)| < |f|] llel]. 
SOLUTION 
For the left side of this inequality, you have 
1 1 x2]! 1 
(F8) = | Fasa) dx = | xdx = =| = = 
0 0 2lo 2 
For the right side of the inequality, you have 


1 


ie = [reyeyae= fasa] = 


0 
and 
: ! Pa a 
lat = [sosa [eas] 
0 0 3Jo 3 
So, 
1 1 
IA = y (5) = 75 ~ 0577, and [CF 8)1 = Ifill a 
LINEAR The concept of work is important for determining the 


energy needed to perform various jobs. If a constant force 
ALGEBRA F acts at an angle 0 with the line of motion of an object to 
APPLIED move the object from point A to point B (see figure below), 

then the work W done by the force is 

W = (cos 6)|F\| |AB| 
=F. AB 

where AB represents the directed line segment from A 

to B. The quantity (cos 6)||F|| is the length of the orthogonal 

projection of F onto AB. Orthogonal projections are 

discussed on the next page. 


iStockphoto.com/kupicoo 
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Figure 5.8 


REMARK 


If v is a unit vector, then 
(v, v) = |v? = 1, and the 
formula for the orthogonal 
projection of u onto v takes 
the simpler form 


projju = (u, v)v. 
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Figure 5.9 
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ORTHOGONAL PROJECTIONS IN INNER PRODUCT SPACES 


Let u and v be vectors in R?. If v is nonzero, then u can be orthogonally projected 
onto v, as shown in Figure 5.7. This projection is denoted by proj,u and is a scalar 
multiple of v, so you can write projyu = av. If a > 0, as shown in Figure 5.7(a), then 
cos 0 > 0 and the length of proj,u is 


_ _ E llull |v] cos@ u.v 
lavl| = |a| |Ivl] = allvl| = [ful] cos 6 = W 


which implies that a = (u -° v)/||v|? = (u + v)/(v © v). So, 


u°.’ y 


proj,u = v. 


vev 
Ifa < 0, as shown in Figure 5.7(b), then the orthogonal projection of u onto v can be 
found using the same formula. (Verify this.) 


a. @ b. 


f 


aa” 


1 

1 

/ t 
rA 1 
1 

1 

1 


projyu =av,a>0 projyu = av, a < 0 


Figure 5.7 


EXAMPLE 9 Finding the Orthogonal Projection of u onto v 


In R?, the orthogonal projection of u = (4, 2) onto v = (3, 4) is 


= 12 i) 
viv. (3,4)-@G,4) 5° 5 


as shown in Figure 5.8. | 


An orthogonal projection in a general inner product space is defined below. 


Definition of Orthogonal Projection 


Let u and v be vectors in an inner product space V, such that v # 0. Then the 
orthogonal projection of u onto v is 


(u, v) 


(yv, v) V. 


DOAI Finding an Orthogonal Projection in R° 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


proj,u = 


Use the Euclidean inner product in R? to find the orthogonal projection of u = (6, 2, 4) 
onto v = (1, 2, 0). 


SOLUTION 


u • v = 10 and v • v = 5, so the orthogonal projection of u onto v is 


‘ 1 
proja = =y = 1001 9,0) = 2(1, 2, 0) = (2, 4,0) 
Vev 5 


as shown in Figure 5.9. m 
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` 


Verify in Example 10 that u — proj,u = (6, 2, 4) — (2, 4, 0) = (4, —2, 4) is 
orthogonal to v = (1, 2, 0). This is true in general. If u and v are nonzero vectors in an 
inner product space, then u — proj,u is orthogonal to v. (In Exercise 90, you are asked 
to prove this.) 

An important property of orthogonal projections used in mathematical modeling 
Le y >e (see Section 5.4) is given in the next theorem. It states that, of all possible scalar 

multiples of a vector v, the orthogonal projection of u onto v is the one closest to u, as 

w shown in Figure 5.10. For instance, in Example 10, this theorem implies that, of all the 
vA a scalar multiples of the vector v = (1, 2, 0), the vector proj,u = (2, 4, 0) is closest to 
J dtu, cv) u = (6, 2, 4). You are asked to prove this explicitly in Exercise 101. 


d(u, projyu) 


THEOREM 5.9 Orthogonal Projection and Distance 


Let u and v be two vectors in an inner product space V, such that v # 0. Then 


cv 
Figure 5.10 


(u, v) 
(v, v) 


d(u, projyu) < d(u, cv), c + 


PROOF 
Let b = (u, v)/(v, v). Then 


lu — cvl? = |(u — bv) + (b — o)l? 


where (u — bv) and (b — c)v are orthogonal. Verify this by using the inner product 
axioms to show that ((u — bv), (b — c)v) = 0. Now, by the Pythagorean Theorem, 


(u — by) + (b = o)l? = lu — by? + || — ovl? 
which implies that 
u — cy|? = |u — by? + (b — oY]. 


b + cand v # 0, so you know that (b — c)?||v||? > 0. This means that 


u — bve < |u — cv? 


and it follows that d(u, bv) < d(u, cv). m 


The next example discusses an orthogonal projection in the inner product space 
Cla, b]. 


l "PP Finding an Orthogonal Projection 
EXAMPLE 11 in Cla, b] (Calculus) 


Let f(x) = 1 and g(x) = x be functions in C[0, 1]. Use the inner product on C[a, b] 
defined in Example 5, 


(ha) = i f(x)g(x) dx 


to find the orthogonal projection of f onto g. 
SOLUTION 


From Example 8, you know that 
(fa) =3 and (gg) =I? = 5 
, 2 , 3 


So, the orthogonal projection of f onto g is 


. (f, g) 1/2 3 
proj, f = A oe = 1/3" = * | 
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5.2 Exercises 


Showing That a Function Is an Inner Product In 
Exercises 1—4, show that the function defines an inner 
product on R?, where u = (u4, u,) and v = (v4, v2). 

1. (u, v) = 3u,v, + uv, 
3. (u, v) = 
4. (u, v) = 2u,v, + u,v; + u,v, + 2uv, 


2. (u, v) = u,v, + 9u,Vv, 


1 
zuv + guv 


Showing That a Function Is an Inner Product In 

Exercises 5-8, show that the function defines an inner 

product on R?, where u = (u4, uz, u3) and v = (vi, Va, V3). 
5. (u, v) 
6. (u, V) = uv; + 2u5v, + u3V3 
7. (u, v) = 4u,v, + 3u,v, + 2uzv3 
8. (u, v) = 


= 2uv; + 3u, + u33 


L 1 
zuv, + FUV + 7U3V3 


Showing That a Function Is Not an Inner Product In 
Exercises 9-12, show that the function does not define an 
inner product on R°, where u = (u,,u,) and v = (v,, v3). 

9. (u, vV) = uwv 10. (u, v) = u,v, — 6u5V5 


11. (u, v) = u?v? — 5512. (u, v) = 3u,v5 — uv] 


Showing That a Function Is Not an Inner Product In 
Exercises 13-16, show that the function does not define 
an inner product on R°, where u = (u,,u,,u3) and 


v = (vis Va V3). 
13. (u, v) = 
14. (u, v) = u,v, — Hav — u3V3 
15. (u, v) = u7 v? + uv 
16. (u, v) = 


T UUU 


ERA 
= 2u, + 3viva + U3 
Finding Inner Product, Length, and Distance In 


Exercises 17-26, find (a) (u,v), (b) |[ul|, (© ||v|, and 
(d) d(u, v) for the given inner product defined on R”. 


17. u = (3,4), v= (5,-12), (uv) =uev 

18. u = (—1,1), v= (6,8), (uv) =u-v 

19. u = (—4,3), v= (0,5), (u,v) = 3u,v, + uv, 
20. u = (0,-6), v=(-1,1), (u,v) = uv; + 2u, 
21. u = (0,7,2), v = (9, -3,-2), (uv) =uev 
22. u = (0,1,2), v=(1,2,0), (uv) =u-ev 

23. u = (8,0, —8), v = (8, 3, 16), 


(u, v) = 2u,v, + 3u,v, + uzv 
24. u = (1,1,1), v=(2,5,2), 

(u, v) = u,v, + 2u,v, + uzv, 
25. u = (—1,2,0,1), v= (0,1,2,2), 
26. u = (1,-1,2,0), v= (2,1,0, —1), 


(u,v) =uev 


(u,v) =uev 


See CalcChat.com for worked-out solutions to odd-numbered exercises. 


5.2 Exercises 


7 


Showing That a Function Is an Inner Product In 
Exercises 27 and 28, let 


A= i faj and B= [ps | 

a, Ay ba bn 
be matrices in the vector space M,,. Show that the 
function defines an inner product on M, ,. 
27. (A, B) 
28. (A, B) = 2a,,;D,, + aibi + aba; + 2a5yb55 


= AD), + dibi + aba + Ayybr, 


Finding Inner Product, Length, and Distance In 
Exercises 29-32, find (a) (A,B), (b) ||Al|, (© |B|], and 
(d) d(A, B) for the matrices in M,, using the inner 
product (A, B) = 2a,,b,, + abi + azaba + 2a,,b,,. 


2 —4 =): 1 
29.4 =|_3 ‘| z=] i | 
1 0 0 1 
k i} d [i o| 
1 -1 0 1 
31. A = | at He E a 
1 0 1 1 
k ol T | E 
Showing That a Function Is an Inner Product In 
Exercises 33 and 34, show that the function defines aninner 
product for polynomials p(x) = a, + ax +++ + + a,x” 
and g(x) = by + bx +: °° + bx". 


33. (p,q) = aobo + 2a,b, + ab, in P, 
34. (p,q) = aba + ab, ++ > + + a,b, in P, 


30. A = 


32. A= 


Finding Inner Product, Length, and Distance In 
Exercises 35-38, find (a) (p,q), (b) ||pl|, (© |\q||, and 
(d) d(p,q) for the polynomials in P, using the inner 
product (p,q) = abo + a,b, + aba. 


35. p(x) = 1 — x + 3x7, q(x) =x- x 
36. px) =1 txt 5x, g(x) =14+ 22 
37. p(x) =1+ 2, ga) =1- x2 

38. p(x) = 1- 3x +2, g(x) = =x + 2x7 


Calculus In Exercises 39-42, use the functions f and 


g in C[-1,1] to find (a) (f,g), (b) Ifl, © lgl, and 
(d) d(f, g) for the inner product 


(fg) = L f (x)g(x) dx. 


fœ) =1, gx) =42-1 
40. ie —x, g(x) =x -—x+2 
41. f(x) =x, g(x) = e 
42. f(x) =x, g(x) =e 
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Finding the Angle Between Two Vectors In Exercises 
43-52, find the angle 0 between the vectors. 


43. u = (3,4), v=(5,-12), (uv) =u-ev 
44.u = (3,-1), v=(1), (uv) =u-v 


45. u = (—4,3), v=(0,5), (u,v) = 3u,v, + uv, 
46. u = (4, —1), v= (2,1), 

(u, v) = 2u,v, + uv 
47. u = (1,1,1), v= (2, —2, 2), 


(u, V) = uv; + 2uv, + uzv 
48. u = (0, 1,—2), v=(,-2,1), (uv) =uev 
49, p(x) == ga) La 
(p, q) = aobo + a,b; + ab, 
50. p(x) =1+ x2, gx) =x- x, 
(p,q) = aobo + 2a,b, + ab, 


51. Calculus f(x) =x, g(x) = x’, 
(8) = f ro F(x) 
52. Calculus f(x) = g(x) = x?, 


(£2) oe 


Verifying Inequalities In Exercises 53-64, verify 
(a) the Cauchy-Schwarz Inequality and (b) the triangle 
inequality for the given vectors and inner products. 


53. u = (5,12), v= (3,4), (uv) =uev 
54.u=(-1,1), v=(,-1), (uv) =u-v 
55. u = (0,1,5), v = (-—4,3,3), (uv) =uev 
56. u = (1,0,2), v=(1,2,0), (uv) =u-v 
57. p(x) = 2x, g(x) = 1 + 3x, 

(p,q) = agbo + a,b, + a,b, 
58. p(x) =x, gx) =1- 2x, 


(p. q} = aobo + 2a,b, + ab, 
0 3 =3 1 
39. a= i B=] 4 3 
(A, B) = abi; + abi + abai + anba 


0 1 1 1 
waf f 3 


(A, B) = abi; + abi + anba + anba 
61. Calculus f(x) = sinx, 


m/4 
(f8) = Í f(x)g(x) dx 


62. Calculus f(x) = x, 


g(x) = cos x, 


g(x) = cos 7x, 


(ha) = | penal) a 


63. Calculus f(x) = x, 


(f8) = Í F(x)gQx) dx 


64. Calculus f(x) = 


a) = | fga 


Calculus In Exercises 65-68, show that f and g are 
orthogonal in the inner product space C[a, b] with the 
inner product 


(fg) = f f(x)g(x) dx. 


65. C|- 7/2, 7/2], f(x) = cosx, g(x) = sinx 

66. C[-1,1], fæ) =x g(x) = 4 (3x2 - 1) 

67. C[-1,1], fi) =x, ga) = 5(5x3 — 3x) 

68. C[0, z], f(x) = 1, g(x) = cos(2nx), 
n=1,2,3,... 


Finding and Graphing Orthogonal Projections in R? 
In Exercises 69-72, (a) find proj,u, (b) find proj,v, and 
(c) sketch a graph of both proj,u and proj,v. Use the 
Euclidean inner product. 


69. u = (1,2), v= (2,1) 

70. u = (-3,-1), v= (6,3) 
71. u=(-1,3), v= (4,4) 
72. u = (2,-2), v= (3,1) 


Finding Orthogonal Projections In Exercises 73-76, 
find (a) proj,u and (b) proj,,v. Use the Euclidean inner 
product. 


73. u = (5, —3, 1), v= (1, -1,0) 

74. u=(1,2,-1), v = (-1,2,-1) 
75. u = (0,1,3,-6), v=(—1,1,2,2) 
76. u = (-1,4, -2,3), v=(2,-1,2,-1) 


Calculus In Exercises 77-84, find the orthogonal 
projection of f onto g. Use the inner product in C[a, b] 


g) = fro dx. 


77. C|[-1,1]), fœ) =x, g(&x)=1 

78. C[-1,1], fœ) =x- x, g(x) =2x-1 
79. C[0,1], f(xy) =x, gx) =e 

80. C[0, 1], f(xy) =x, g(x) =e 

81. Cl- r, 7], f(x) = sinx, g(x) = cosx 
82. Cl- m, z], f(x) = sin2x, g(x) = cos 2x 
83. C[-7, 7], f(x) =x, g(x) = sin 2x 

84. C[-7, 7], f(x) =x, g(x) = cos 2x 
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True or False? In Exercises 85 and 86, determine 
whether each statement is true or false. If a statement 
is true, give a reason or cite an appropriate statement 
from the text. If a statement is false, provide an example 
that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 
85. (a) The dot product is the only inner product that can be 
defined in R”. 
(b) A nonzero vector in an inner product can have a 
norm of zero. 
86. (a) The norm of the vector u is the angle between u and 
the positive x-axis. 
(b) The angle 0 between a vector v and the projection 
of u onto v is obtuse when the scalar a < 0 and 
acute when a > 0, where av = proj,u. 


87. Let u = (4, 2) and v = (2, — 2) be vectors in R? with 
the inner product (u, v} = u,v, + 2uyVv>. 
(a) Show that u and v are orthogonal. 


(b) Sketch u and v. Are they orthogonal in the Euclidean 
sense? 


88. Proof Prove that 

lu + vP + fu — vP = 2fjulP + 21v 

for any vectors u and v in an inner product space V. 
89. Proof Prove that the function is an inner product on R”. 
c; > 0 
90. Proof Let u and v be nonzero vectors in an inner 


product space V. Prove that u — proj,u is orthogonal 
to v. 


-+ cC uV 


non n?’ 


(u, V) = CMV, + CV +: 


91. Proof Prove Property 2 of Theorem 5.7: If u, v, 
and w are vectors in an inner product space V, then 
(u + v, w) = (u, w) + (v, w). 

92. Proof Prove Property 3 of Theorem 5.7: If u and v 
are vectors in an inner product space V and c is any real 
number, then (u, cv) = c/u, v}. 

93. Guided Proof Let W be a subspace of the inner 
product space V. Prove that the set 


WŁ = {v E V: (v, w) = 0 for all w € W} 
is a subspace of V. 


Getting Started: To prove that W+ is a subspace of 
V, you must show that W+ is nonempty and that the 
closure conditions for a subspace hold (Theorem 4.5). 


(i) Find a vector in W+ to conclude that it is nonempty. 


Gi) To show the closure of W+ under addition, you 
need to show that (v, + v,, w) = 0 for all w © W 
and for any v,,v, © W+. Use the properties of 
inner products and the fact that (v,, w) and (v5, w) 
are both zero to show this. 


(iii) To show closure under multiplication by a scalar, 
proceed as in part (11). Use the properties of inner 
products and the condition of belonging to W+. 
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94. Use the result of Exercise 93 to find W+ when W is the 
span of (1, 2, 3) in V = RÈ. 

95. Guided Proof Let (u,v) be the Euclidean inner 
product on R”. Use the fact that (u, v) = u’v to prove 
that for any n x n matrix A, 

(a) (ATAu, v) = (u, Av) 

and 

(b) (A7Au, u) = |Aul?. 

Getting Started: To prove (a) and (b), make use of both 

the properties of transposes (Theorem 2.6) and the 

properties of the dot product (Theorem 5.3). 

(i) To prove part (a), make repeated use of the property 
(u, v) = u’v and Property 4 of Theorem 2.6. 

Gi) To prove part (b), make use of the property 
(u, v) = u’v, Property 4 of Theorem 2.6, and 
Property 4 of Theorem 5.3. 


96. CAPSTONE 


(a) Explain how to determine whether a function 
defines an inner product. 


(b) Let u and v be vectors in an inner product space V, 
such that v # 0. Explain how to find the orthogonal 
projection of u onto v. 


Finding Inner Product Weights In Exercises 97-100, 
find c, and c, for the inner product of R?, 


(uU, V) = CyUyVy + CU 


such that the graph represents a unit circle as shown. 


97. y 98. y 
A A 
3+ 4+ 
a+ 
[jul| = 1 lla =1 
x = kx 
33 2 3 -3 3 
23 
=3 F rey 
99. y 100. A 
54 6+ 
4+ 
jul = F w=: 
HH HH x } be x 
-5 - 3 5 —6 6 
Al 
sT l 


101. Consider the vectors 
u = (6, 2, 4) and v = (1, 2, 0) 
from Example 10. Without using Theorem 5.9, show 
that among all the scalar multiples cv of the vector 


v, the projection of u onto v is the vector closest to 
u—that is, show that d(u, proj,u) is a minimum. 
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5.3 Orthonormal Bases: Gram-Schmidt Process 


REMARK 


In this section, when the 
inner product space is R” ora 
subspace of R”, assume that 
the inner product used is the 
Euclidean inner product (dot 
product) unless otherwise 
noted. 


wl Show that a set of vectors is orthogonal and forms an orthonormal 
basis, and represent a vector relative to an orthonormal basis. 


P| Apply the Gram-Schmidt orthonormalization process. 


ORTHOGONAL AND ORTHONORMAL SETS 


You saw in Section 4.7 that a vector space can have many different bases. While studying 
that section, you may have noticed that some bases are more convenient than others. For 
example, R? has the basis B = {(1, 0, 0), (0, 1, 0), (0, 0, 1)}. This set is the standard basis 
for R? because it has important characteristics that are particularly useful. One important 
characteristic is that the three vectors in the basis are mutually orthogonal. That is, 


(1, 0, 0) - (0, 1,0) =0 

(1, 0, 0) - (0,0, 1) =0 

(0, 1, 0) + (0,0, 1) = 0. 
A second important characteristic is that each vector in the basis is a unit vector. (Verify 
this by inspection.) 

This section identifies some advantages of using bases consisting of mutually 


orthogonal unit vectors and develops a procedure for constructing such bases, known 
as the Gram-Schmidt orthonormalization process. 


Definitions of Orthogonal and Orthonormal Sets 


A set S of vectors in an inner product space V is orthogonal when every pair of 
vectors in S is orthogonal. If, in addition, each vector in the set is a unit vector, 
then S is orthonormal. 


For S = {V}, V2. . ., V,}, this definition has the form below. 
Orthogonal Orthonormal 
1. (vav) = 0, £77 1. (v, v) = 0, i 4 j 
2. |v] = 1, i= 1,2,...,2” 


If S is a basis, then it is an orthogonal basis or an orthonormal basis, respectively. 

The standard basis for R” is orthonormal, but it is not the only orthonormal basis 
for R”. For example, a nonstandard orthonormal basis for R? can be formed by rotating 
the standard basis about the z-axis, resulting in 


B = {(cos 9, sin 0, 0), (— sin 0, cos 0, 0), (0, 0, 1)} 


as shown below. Verify that the dot product of any two distinct vectors in B is zero, and 
that each vector in B is a unit vector. 


N 


Na 
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Example 1 describes another nonstandard orthonormal basis for R?. 


EXAMPLE 1 A Nonstandard Orthonormal Basis for R? 


Show that the set is an orthonormal basis for R?. 
vaken (= 50), -4 2 22), (2 0) 
1? T2 13 SX JIT o > $ 3’ 


6° 6’ 3 3°3 
SOLUTION 
First show that the three vectors are mutually orthogonal. 
1 1 
vev 6 + 6 +0=0 
2 


TE es ae 
9 


Vo ° V3 9 9 


Now, each vector is of length 1 because 
l= View = v2 +2+0=1 
Ivl = vyt v2 = Vigtigto=l 
Wal = V¥s 5 = V5 4545-1. 


So, S is an orthonormal set. The three vectors do not lie in the same plane (see Figure 
Figure 5.11 5.11), so you know that they span R?. By Theorem 4.12, they form a (nonstandard) 
orthonormal basis for R°. | 


EXAMPLE 2 An Orthonormal Basis for P, 


In P;, with the inner product 


(p, q} = aobo + a,b, + a,b, + azb; 


the standard basis B = {1, x, x, x°} is orthonormal. The verification of this is left as an 
exercise. (See Exercise 17.) | 


LINEAR Time-frequency analysis of irregular physiological signals, 

ALGEBRA such as beat-to-beat cardiac rhythm variations (also known 
as heart rate variability or HRV), can be difficult. This is 

APPLIED because the structure of a signal can include multiple 
periodic, nonperiodic, and pseudo-periodic components. 
Researchers have proposed and validated a simplified HRV 
analysis method called orthonormal-basis partitioning and 
time-frequency representation (OPTR). This method can 
detect both abrupt and slow changes in the HRV signal’s 
structure, divide a nonstationary HRV signal into segments 
that are “less nonstationary,” and determine patterns in the 
HRV. The researchers found that although it had poor time 
resolution with signals that changed gradually, the OPTR 
method accurately represented multicomponent and abrupt 
changes in both real-life and simulated HRV signals. 
(Source: Orthonormal-Basis Partitioning and Time-Frequency 
Representation of Cardiac Rhythm Dynamics, Aysin, Benhur, et al, 
IEEE Transactions on Biomedical Engineering, 52, no. 5) 


Sebastian Kaulitzki/Shutterstock.com 
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Chapter 5 


Jean-Baptiste Joseph Fourier 
(1768-1830) 


Fourier was born in Auxerre, 
France. He is credited as a 
significant contributor to 

the field of education for 
scientists, mathematicians, 
and engineers. His research 
led to important results 
pertaining to eigenvalues 
(Section 7.1), differential 
equations, and what would 
later become known as Fourier 
series (representations of 
functions using trigonometric 
series). His work forced 
mathematicians to 
reconsider the 

accepted, but 

narrow, definition 

of a function. 


Inner Product Spaces 


The orthogonal set in the next example is used to construct Fourier approximations 
of continuous functions. (See Section 5.5.) 


EXAMPLE 3 An Orthogonal Set in C[0, 27] (Calculus) 


In C[0, 27], with the inner product 


(re) = | Ped 


show that the set S = {1, sin x, cos x, sin 2x, cos 2x,. . ., sin nx, cos nx} is orthogonal. 


SOLUTION 


To show that this set is orthogonal, verify the inner products listed below, where m and 
n are positive integers. 


2r 
(1, sin nx) = f sin nx dx = 0 
0 


20 


(1, cos nx) -| cos nx dx = 0 
0 


2n 
(sin mx, cos nx} = f 

0 
2n 


sin mx cos nx dx = 0 


sin mx sin nxdx =0, m+n 


(sin mx, sin nx) = f 
0 
Qn 


cos mx cos nxdx= 0, m#n 


(cos mx, cos nx) = f 


0 


One of these inner products is verified below, and the others are left to you. If 
m # n, then use the formula for rewriting a product of trigonometric functions as a sum 
to obtain 
2m i 2m 
[ sin mx cos nx dx = Al [sin(m + n)x + sin(m — n)x] dx = 0. 
0 0 


If m = n, then 


2n 1 Qn 
: = aa _ 
sin nx cos nx dx = =| sin- nx = 0. 
A 2n o T 


The set S in Example 3 is orthogonal but not orthonormal. An orthonormal set can 
be formed, however, by normalizing each vector in S. That is, 


2n 
a2 = f dx = 27 
0 
2m 
||sin nx||? = i sin? nx dx = 1 
0 


2n 
\|lcos nx? = f cos? nx dx = n 
0 


so it follows that the set 


COS x, sin nx, 


P Jr sin X, 7 ee ar COS nx} 


is orthonormal. 


© Science and Society/SuperStock 
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Each set in Examples 1, 2, and 3 is linearly independent. This is a characteristic of 
any orthogonal set of nonzero vectors, as stated in the next theorem. 


THEOREM 5.10 Orthogonal Sets Are Linearly Independent 


If S = {v,,v5,...,V,$ is an orthogonal set of nonzero vectors in an inner 
product space V, then S is linearly independent. 


PROOF 
You need to show that the vector equation 
CV, + OV, +--+ tey = 0 
implies c} = c, =- - - = c, = 0. To do this, form the inner product of both sides of 
the equation with each vector in S. That is, for each i, 
((cyv, + eV, +--+ +> tov, +--+ + ey), va = (0, v) 
CV, V;) + CVa V;) t+ + + + oXv, Vj; + °° + t e Ya Vv) = 0. 


Now, S is orthogonal, so (v,, v;) = 0 for j # i, and the equation reduces to 
cAV;, V;) = 0. 

But each vector in S is nonzero, so you know that 
(va V;) = |v? # 0. 


This means that every c; must be zero and the set must be linearly independent. m 


As a consequence of Theorems 4.12 and 5.10, you have the corollary below. 


THEOREM 5.10 Corollary 


If V is an inner product space of dimension n, then any orthogonal set of n 
nonzero vectors is a basis for V. 


EXAMPLE 4 Using Orthogonality to Test for a Basis 


Show that the set S below is a basis for R4. 


Yi Vo V3 V4 
S = {(2, 3; 2 =2), (1, 0, 0, 1), (- 1, 0, 2, 1), (- 1, 2, ma 1, 1)} 
SOLUTION 


The set S has four nonzero vectors. By the corollary to Theorem 5.10, you can show 
that S is a basis for R* by showing that it is an orthogonal set. 

V,°v,=2+07+0-2=0 

v.n = -2+0+4-2=0 

vev =-2+6-2-2=0 

vyv = —-1+0+0+1=0 

v.v =-1+0+0+1=0 

vev =l1+0-2+1=0 


S is orthogonal, and by the corollary to Theorem 5.10, it is a basis for R4. m 
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Ww) = projw | i 


w=w t+ Wo =ci+ cj 
Figure 5.12 


Section 4.7 discusses a technique for finding a coordinate representation relative to 
a nonstandard basis. When the basis is orthonormal, this procedure can be streamlined. 

Before looking at this procedure, consider an example in R. Figure 5.12 shows 
an orthonormal basis for R?, i = (1,0) and j = (0, 1). Any vector w in R? can be 
represented as w = w; + w,, where w, = proj;w and w, = proj;w. The vectors i and 
j are unit vectors, so it follows that w, = (w ° i)i and w, = (w « j)j. Consequently, 


w=w,tws=(weiit we jpj= cit oj 


which shows that the coefficients c} and c, are simply the dot products of w with the 
respective basis vectors. The next theorem generalizes this. 


THEOREM 5.11 Coordinates Relative to an Orthonormal Basis 


If B = {v,, V>,. . .,V,,} is an orthonormal basis for an inner product space V, 


then the coordinate representation of a vector w relative to B is 


w = (W, ViVi + (W, Va) Va +--+ + (Ww, VY, 


PROOF 
B is a basis for V, so there must exist unique scalars c}, C2, . . ., ¢,, such that 
W = CV, + CW +++ E C We 


Taking the inner product (with v;) of both sides of this equation, you have 
(w, v) = (cv, + CVa ++ + + E CY), Vi) 
= €)(Vj, V;) + CVa Vj) + °° + + CY Vi 
and by the orthogonality of B, this equation reduces to 
(w, V;) = CAV;, V;). 
B is orthonormal, so you have (v,, v;) = ||v;|? = 1, and it follows that (w, v) = c;. | 
In Theorem 5.11, the coordinates of w relative to the orthonormal basis B are 


called the Fourier coefficients of w relative to B, after Jean-Baptiste Joseph Fourier. 
The corresponding coordinate matrix of w relative to B is 


[w]e = [c c. . c, E = Kw, vi) (w, vy)... (w, vp. 


EEE z mj Representing Vectors Relative 
EXAMPLE 5 to an Orthonormal Basis 


Find the coordinate matrix of w = (5, — 5, 2) relative to the orthonormal basis B for 
R? below. 


vi vV V3 
B= {(5,5,0), (3. 5,0), (0,0, )} 

SOLUTION 

B is orthonormal (verify this), so use Theorem 5.11 to find the coordinates. 
wv, = (5, -5,2)° (2,40) = -1 
wv, = (5, —5,2)-(-$3,0) = -7 
wv; = (5, —5, 2) * (0,0, 1) = 2 


So, the coordinate matrix relative to Bis[w], = [-1 -7 2F. Lu 
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REMARK 


The Gram-Schmidt 
orthonormalization process 
leads to a matrix factorization 
similar to the LU-factorization 
you studied in Chapter 2. You 
are asked to investigate this 
OR-factorization in Project 1 
on page 293. 


v2 
vi 


{V1, V2} is a basis for R2. 
Figure 5.13 
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GRAM-SCHMIDT ORTHONORMALIZATION PROCESS 


Having seen one of the advantages of orthonormal bases (the straightforwardness 
of coordinate representation), you will now look at a procedure for finding such a 
basis. This procedure is called the Gram-Schmidt orthonormalization process, after 
the Danish mathematician Jorgen Pederson Gram (1850-1916) and the German 
mathematician Erhardt Schmidt (1876-1959). It has three steps. 


1. Begin with a basis for the inner product space. It need not be orthogonal nor 
consist of unit vectors. 


2. Convert the basis to an orthogonal basis. 


3. Normalize each vector in the orthogonal basis to form an orthonormal basis. 


THEOREM 5.12 Gram-Schmidt Orthonormalization Process 


1. Let B = {v}, v>,. . ., V,} be a basis for an inner product space V. 
2. Let B’ = {w,, W3, . . ., W,}, where 
_ (Vp, Wy) 
= V5 (w, w jM 
i Wi 


(V3; Wy) wi 
(wi, W 


(V3, w,) 
(Way Wa) ° 


1 


E Ye wi) w 
(Wi, W1) 


Then B’ is an orthogonal basis for V. 


_ (Vp W2) eee ee ees, (Ye Wi 1) 
(Wa, W2) : (Wa W1) aai 


w 


H~ Yä 


3. Let u; = "i Then B” = {u,,U5,. . 
III 7 


Also, span{v,, V». - 


., U,} is an orthonormal basis for V. 


.,V,} = span{u,,u,,...,u,}fork=1,2,...,n. 


Rather than give a proof of this theorem, it is more instructive to discuss a special 
case for which you can use a geometric model. Let {v,, v5} be a basis for R?, as shown 
in Figure 5.13. To determine an orthogonal basis for R?, first choose one of the original 
vectors, say v}, and call it w,. Now you want to find a second vector orthogonal to w,. 
The figure below shows that v, — proj, V, has this property. 


Proj y,V2 


W = Vo — projy V2 
is orthogonal to wy = v4. 


vo°W 
22 o i w4, you can conclude 
wew 


that the set {w,, w,} is orthogonal. By the corollary to Theorem 5.10, it is a basis for 
R?. Finally, by normalizing w, and w,, you obtain the orthonormal basis for R? below. 


{u,,u,} = [E Ea] 


lwl wal 


By letting w, = v, and w, = v, — proj, V3 = V3 — 
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REMARK 


An orthonormal set derived 
by the Gram-Schmidt 
orthonormalization process 
depends on the order of 

the vectors in the basis. For 
instance, rework Example 6 
with the original basis ordered 
as {v,, v,} rather than {v,, v3}. 


y 


(0, 1) D 


| 
pee 
eee 


A 
[7 v2 (2 v2 
22 chines, A 2 
r Uy uj ` 
t | >x 
-1 1 


Orthonormal basis: B” = {u}, u2} 
Figure 5.14 


Inner Product Spaces 


Applying the Gram-Schmidt 
Orthonormalization Process 


EXAMPLE 6 


Apply the Gram-Schmidt orthonormalization process to the basis B for R? below. 


vi vz 
B = {(1, 1), (0, 1)} 
SOLUTION 


The Gram-Schmidt orthonormalization process produces 
w =v, = (1,1) 
1 z) 
r2 


VvV ° Wi 
wew 

The set B’ = {w,, wz} is an orthogonal basis for R?. By normalizing each vector in B’, 

you obtain 


Ww, =v, w, = (0, 1) 4,0 =( 


0 = yn d= (SF) 


u = Pe = $4) = 2-43) - 22) 
* [wall 1//2\ 2°2 2'2 P 
So, B” = {u}, u,} is an orthonormal basis for R?. See Figure 5.14. u 


EXAMPLE 


Apply the Gram-Schmidt orthonormalization process to the basis B for R°? below. 


Applying the Gram-Schmidt 
Orthonormalization Process 


vi v V3 
B = {(, i 0), (1; 2; 0), (0, 1; 2)} 

SOLUTION 

Applying the Gram-Schmidt orthonormalization process produces 


w =v, = (1, 1,0) 


= Vo * Wi _ _3 - 11 ) 
W2 V2 w é wh (1; 2; 0) 5 (1, l, 0) ( ph 79 
w = V3 V3 ° Wi w, V3 ° W3 w 
wi? WwW Wy ° Wo 
= 1 1/2/ 11 
= (0,1,2) = 540,1,0) - 12(-4 40) 
= (0, 0, 2). 


The set B’ = {w,, w,, W3} is an orthogonal basis for R3. Normalizing each vector in 
B’ produces 


wis (1.0 = (2 0) 


“Iw 2 TE 
u= f Tal ra) el aera) 


= z 
u, NAI 5 (0, 0, 2) (0, 0, 1). 


So, B” = {u,, u,, uy} is an orthonormal basis for R3. ui 
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Examples 6 and 7 apply the Gram-Schmidt orthonormalization process to bases for 
R? and R°. The process works equally well for a subspace of an inner product space. 
The next example demonstrates. 


poe = =| Applying the Gram-Schmidt 
EXAMPLE 8 Orthonormalization Process 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


The vectors 
v, = (0,1,0) and vy, = (1,1, 1) 
span a plane in R°. Find an orthonormal basis for this subspace. 


SOLUTION 


Š Applying the Gram-Schmidt orthonormalization process produces 


wan- enin aE 
2 2: 1 1 


Normalizing w, and w, produces the orthonormal set 


u, = = (0,1,0) 
liw; 


u = Wo = EE 0, 1) = (2 0, v2), 
Iwl V2 2’? 2 
Figure 5.15 See Figure 5.15. m 


Ep FP Applying the Gram-Schmidt 
EXAMPLE 9 Orthonormalization Process (Calculus) 


Apply the Gram-Schmidt orthonormalization process to the basis B = {1, x, x?} in P}, 
using the inner product 


(p. q) = f Pogo) dx. 


SOLUTION 
Let B = {1, x, x?} = {v,, Və, V3}. Then you have 


w,=v,=1 


(Vo, W1) 0 
Ww w =x- (1) =x 
2 2 Mwy ' 2 
(v3, Wi) (V3, W2) , 2/3 0 1 
wW = Vv WwW, = x 1) - xy =r- 
s5 Gwn w) E waw)? wE a 
Now, by normalizing B’ = {w,, W», W3}, you have 
REMARK a ==) = 
eRe eee r ‘(will v2 J2 
e polynomials u,, u,, an 
u} in Example 9 are called the u, = w a l (x) = VEN 
first three normalized Legendre lwll 273 J2 
polynomials, after the French Ww; 1 ( r £) J/5 (3x2 — 1) 
mathematician Adrien-Marie u; = = xX xX ` 
w V 3 
Legendre (1752-1833). [wil 8/45 2/2 
In Exercises 43—48, you are asked to verify these calculations. m 
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The computations in the Gram-Schmidt orthonormalization process are sometimes 
simpler when you normalize each vector w; before you use it to determine the next 
vector. This alternative form of the Gram-Schmidt orthonormalization process has 
the steps listed below. 


Se E A 
‘Iwill vil 
7, where w, = v, — (v, upu; 


=] 


wl 


2 


wW. 
u, = Iw’ where w, = v, — (V3, U,)U, — (V3, U,)U, 
3 


w 
u = wi T where w, = v, — (v,,U,)U, — °° oe (V,,U,_,)U,_ | 
n 


n 


z Alternative Form of the Gram-Schmidt 
EXAMPLE 10 Orthonormalization Process 


Find an orthonormal basis for the solution space of the homogeneous linear system. 


Ky Fx, + Ix, =0 
2x, + x, + 2x, + 6x, = 0 


SOLUTION 


The augmented matrix for this system reduces as shown below. 


1 1 0 7 0 3 1 0 2 =l 0 
È 1 2 6 d lo Le. = 2 8 d 


If you let x, = s and x, = t, then each solution of the system has the form 


Xi =25 +t =2 1 
X| __| 2s — 8t a4 2 ag = l 
X3 s 1 0 
X4 t 0 1 


So, one basis for the solution space is 
B = {v v} = {(=2, 2, 1, 0), G, —8, 0, 1)}. 


To find an orthonormal basis B’ = {u,, u}, use the alternative form of the 
Gram-Schmidt orthonormalization process, as shown below. 
lv, 


22 
(5530) 


W = V — (V2, U,)U; 


E n - |a, -8,0, D-( 2 Lo)l( z : : o) 
= (-3, -4,2,1) 


Vi 
u =a 
[ill 


W]e 


W2 
i= 
2 lwl 


={ FG Fo Fe Fi) T 
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5.3 Exercises 263 


See CalcChat.com for worked-out solutions to odd-numbered exercises. 


Orthogonal and Orthonormal Sets In Exercises 
1-12, (a) determine whether the set of vectors in R” is 
orthogonal, (b) if the set is orthogonal, then determine 
whether it is also orthonormal, and (c) determine whether 
the set is a basis for R”. 

1. {(2, —4), (2, 1)} 2. {(-3, 5), (4, 0)} 

34 43 1 _2 
LG. d= 4 {8 0. G=] 
{(4, — 1, 1), (— 1, 0, 4), (—4, — 17, — 1)} 

2, —4, 2), (0, 2, 4), (- 10, —4, 2)} 


7 oh) 99) 


We 5 


A mnog 


v2 0, 
PeP £EH(24 4) 
(2, 5, —3), (4, 2, 6)} 


6° 3° 6 e E 3 
E 6. 3,2, 1), (2.0, 6,0)} 
tO a 
(Mec Bhoornaren 


Peo] 


10 °°? 10 


Normalizing an Orthogonal Set In Exercises 13-16, 
(a) show that the set of vectors in R” is orthogonal, and 
(b) normalize the set to produce an orthonormal set. 


13. {(—1, 3), (12, 4)} 14. {(2, —5), (10, 4)} 
15. {(V3, V3, V3), (- 2,0, V2)} 
16. { (5. —7 ia) (Fw 0} 


17. Complete Example 2 by verifying that {1, x, x2, x°} 
is an orthonormal basis for P, with the inner product 
(p, q) = aobo + a,b, + ab, + azb3. 

18. Verify that {(sin 0, cos 0), (cos 0, — sin 0)} is an 
orthonormal basis for R?. 


Finding a Coordinate Matrix In Exercises 19-24, find 
the coordinate matrix of w relative to the orthonormal 
basis B in R”. 


19. w = (1, 2), B = (2 vB) ec 2x13) 


13 ° 13 B° 13 
20. w = (4, -3), B= (8 x6), = 2) 


21. w = (2, —2, 1), 


s- (re to h e0 (50e) 


10’ +0, 10 “ 


22. w = (3, —5, 11), B = {(1, 0, 0), (0, 1, 0), (0, 0, 1)} 


( 
= (5, 10, 15), B = {(3, 4, 0), (—5, 3, 0), (0, 0, D} 
= (2, —1, 4, 3), 


B = 1550; 1.0), (0, 1, 0, 0), (-3 50,50 0), (0,0,0, 1)} 


Applying the Gram-Schmidt Process In Exercises 
25-34, apply the Gram-Schmidt orthonormalization 
process to transform the given basis for R” into an 
orthonormal basis. Use the vectors in the order in which 
they are given. 
29. B = {(2, 1, =2), (i, 2, 2), (2, =2, 1)} 

30. B = {(1, 0, 0), (1, 1, 1), (1, 1, —1)} 

31. B= {(4, —3, 0), (1, 2; 0), (0, 0, 4)} 

32. B= {(0, 1, 2), (2, 0; 0), G, I, 1)} 

33. B = {(0, 1, 1), (1, 1, 0), (1, 0, 1)} 


34. B = {(3, 4, 0, 0), (— 1, l, 0, 0), (2, 1,0, = 1), (0, 1, 1,0)} 


Applying the Gram-Schmidt Process In Exercises 
35-40, apply the Gram-Schmidt orthonormalization 
process to transform the given basis for a subspace of 
R” into an orthonormal basis for the subspace. Use the 
vectors in the order in which they are given. 


35. B = {(—8, 3, 5)} B = {(2, —9, 6)} 

37. B = {(3, 4, 0), (2, 0, 0)} 

38. B = {(1, 3, 0), (3, 0, —3)} 

39. B = {(1, 2, — 1, 0), (2,2, 0, 1), (1, 1, — 1, 0)} 

40. B = {(7, 24, 0, 0), (0, 0, 1, 1), (0, 0, 1, —2)} 

41. Use the inner product (u, v) = 2u,v, + upv, in R? 


and the Gram-Schmidt orthonormalization process to 
transform {(2, — 1), (— 2, 10)} into an orthonormal basis. 


42. Writing Explain why the result of Exercise 41 is not 
an orthonormal basis when you use the Euclidean inner 
product on R?. 


Calculus In Exercises 43-48, let B = {4, x, x?} be a 
basis for P, with the inner product 


cvoa) = [' plea) a 


Complete Example 9 by verifying the inner products. 


43. (x, 1) =0 44. (1,1) =2 
45. (x7, 1) = § 46. (x?,x) =0 
47. (x, x) = Z 48. (x2 — L, x +) = a 
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Applying the Alternative Form of the Gram-Schmidt 
Process In Exercises 49-54, apply the alternative 
form of the Gram-Schmidt orthonormalization process 
to find an orthonormal basis for the solution space of 
the homogeneous linear system. 

49. x, — 2x, + x, =0 50. x, + 3x, — 3x, = 0 
51, x, = 


xi — 2x, + xX, +x, = 0 


Xo +x, +x, =0 


52. x, +X, —- n= x, =0 
2x4, = 0 
53. 2x, + x, — 6x, + 2x, =0 
xi + 2x, — 3x3 + 4x, = 0 
x + G= 3x5 F 2x, = 0 
$4. =x #25 Xa 7 Hy 
2X, — X_ + 2x, — x, + 2x, = 0 


2X, Fi x5 = 2X5 = 


x; = 0 


True or False? In Exercises 55 and 56, determine 
whether each statement is true or false. If a statement 
is true, give a reason or cite an appropriate statement 
from the text. If a statement is false, provide an example 
that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


55. (a) A set S of vectors in an inner product space V 
is orthogonal when every pair of vectors in S is 
orthogonal. 


(b) An orthonormal basis derived by the Gram-Schmidt 
orthonormalization process does not depend on the 
order of the vectors in the basis. 


56. (a) A set S of vectors in an inner product space V is 


orthonormal when every vector is a unit vector and 
each pair of vectors is orthogonal. 


(b) If a set of nonzero vectors S in an inner product 
space V is orthogonal, then S is linearly independent. 


Orthonormal Sets in P, In Exercises 57-62, let 
p(x) =a, + ax +a x? and g(x) =5b,+ b,x + bx? 
be vectors in P, with (p,q) = abo + a,b, + a,b). 
Determine whether the polynomials form an 
orthonormal set, and if not, apply the Gram-Schmidt 
orthonormalization process to form an orthonormal set. 
57. {1, x, x7} 58. {x?, 2x + x7, 1 + 2x + x7} 
+ 12x? 12x — 5x? 
59, {-1+x2,-1l+x} 60. [> £ | 


13 
1+ x? =lat 
a, (ite attsts) 
62. { /2(-1 + x), /2(2 +. x + x2} 


63. Proof Let {u,,u,,. . 
for R”. Prove that 


ne u,} be an orthonormal basis 


IWP = |v ay + [ve w]? ene |? 


for any vector v in R”. This equation is Parseval’s 
equality. 


64. Guided Proof Prove that if w is orthogonal to each 
vector in S = {v,,V5,. . ., V,}, then w is orthogonal to 
every linear combination of vectors in S. 

Getting Started: To prove that w is orthogonal to every 

linear combination of vectors in S, you need to show 

that their inner product is 0. 

(i) Write v as a linear combination of vectors, with 
arbitrary scalars c,,. . .,c,, in S. 

(ii) Form the inner product of w and v. 

(iii) Use the properties of inner products to rewrite the 
inner product (w, v) as a linear combination of the 
inner products (w, v,),i=1,...,7. 

(iv) Use the fact that w is orthogonal to each vector in S 
to lead to the conclusion that w is orthogonal to v. 

65. Proof Let P be ann x n matrix. Prove that the three 
conditions are equivalent. 

(a) P~! = PT. (Such a matrix is orthogonal.) 

(b) The row vectors of P form an orthonormal basis for R”. 

(c) The column vectors of P form an orthonormal basis 

for R”. 

66. Proof Let W be a subspace of R”. Prove that the 
intersection of W and W+ is {0}, where W+ is the 
subspace of R” given by 


WŁ = {v: w » v = 0 for every w in W}. 
Fundamental Subspaces In Exercises 67 and 68, find 


bases for the four fundamental subspaces of the matrix 
A listed below. 


N(A) = nullspace of A N(AT) = nullspace of AT 
R(A) = column space of A R(AT) = column space of AT 
Then show that N(A) = R(AT)+ and N(A7) = R(A)+. 


1 1 = 0 1 =1 
67. | 0 2 1 68. |0 -2 2 
1 3 0 0 =1 1 


69. Let A be an m x n matrix and let N(A), N(AT), R(A), and 
R(A’) be the subspaces in Exercises 67 and 68. 


(a) Explain why R(A”) is the same as the row space of A. 
(b) Prove that N(A) C R(A7)+. 
(c) Prove that N(A) = R(A7)+. 
(d) Prove that N(A7) = R(A)+. 


70. CAPSTONE Let B be a basis for an inner 
product space V. Explain how to apply the 


Gram-Schmidt orthonormalization process to form 
an orthonormal basis B’ for V. 


71. Find an orthonormal basis for R* that includes the vectors 


and v, = (o. 


v= (200) > 
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5.4 Mathematical Models and Least Squares Analysis 


Figure 5.16 


REMARK 


The term least squares comes 
from the fact that minimizing 
||Ax — b|| is equivalent to 
minimizing ||Ax — bl|?, which 
is a sum of squares. 


Define the least squares problem. 


Find the orthogonal complement of a subspace and the projection 
of a vector onto a subspace. 


Find the four fundamental subspaces of a matrix. 
Solve a least squares problem. 
Use least squares for mathematical modeling. 


THE LEAST SQUARES PROBLEM 


In this section, you will study inconsistent systems of linear equations and learn how 
to find the “best possible solution” of such a system. The necessity of “solving” 
inconsistent systems arises in the computation of least squares regression lines, as 
illustrated in Example 1. 


EXAMPLE 1 Least Squares Regression Line 


Let (1, 0), (2, 1), and (3, 3) be three points in R?, as shown in Figure 5.16. How can 
you find the line y = cy + c,x that “best fits” these points? One way is to note that if 
the three points were collinear, then the system of equations below would be consistent. 


C+ ¢, =0 
Co + 2c, = 1 
C + 3c, =3 


This system can be written in the matrix form Ax = b, where 


1 4 0 
A=|1 2], b=]|1l, and x= [9 
1 3 3 “1 


The points are not collinear, however, so the system is inconsistent. Although it is 
impossible to find x such that Ax = b, you can look for an x that minimizes the norm 
of the error ||Ax — bl|. The solution x = [cy _c, |’ of this minimization problem results 
in the least squares regression line y = cy + cx. 


In Section 2.6, you briefly studied the least squares regression line and how to 
calculate it using matrices. Now you will combine the ideas of orthogonality and 
projection to develop this concept in more generality. To begin, consider the linear 
system Ax = b, where A is an m x n matrix and b is a column vector in R”. You know 
how to use Gaussian elimination with back-substitution to solve for x when the system 
is consistent. When the system is inconsistent, however, it is still useful to find the “best 
possible” solution; that is, the vector x for which the difference between Ax and b is 
smallest. One way to define “best possible” is to require that the norm of Ax — b be 
minimized. This definition is the heart of the least squares problem. 


Least Squares Problem 


Given an m x n matrix A and a vector b in R”, the least squares problem is to 
find x in R” such that ||Ax — b]|? is minimized. 
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ORTHOGONAL SUBSPACES 


To solve the least squares problem, you first need to develop the concept of orthogonal 
subspaces. Two subspaces of R” are orthogonal when the vectors in each subspace are 
orthogonal to the vectors in the other subspace. 


Definition of Orthogonal Subspaces 


The subspaces S, and S, of R” are orthogonal when v; * v, = 0 for all v, in S, 
and all v, in S}. 


EXAMPLE 2 Orthogonal Subspaces 


The subspaces 


1 1 —1 
S,; = spanį |0|, | 1 and S, = span 1 
1/10 1 


are orthogonal because the dot product of any vector in S, and any vector in S, is zero. 


Notice in Example 2 that the zero vector is the only vector common to both S, 
and S,. This is true in general. If S} and S, are orthogonal subspaces of R”, then their 
intersection consists of only the zero vector. You are asked to prove this in Exercise 45. 

Given a subspace S of R”, the set of all vectors orthogonal to every vector in S is 
the orthogonal complement of S, as stated in the next definition. 


Definition of Orthogonal Complement 


If S is a subspace of R”, then the orthogonal complement of S is the set 
S+ = {u € R”: v + u = 0 forall vectors v E€ S}. 


The orthogonal complement of the trivial subspace {0} is all of R”, and, conversely, 
the orthogonal complement of R” is the trivial subspace {0}. In Example 2, the subspace 
S, is the orthogonal complement of S,, and the subspace S, is the orthogonal complement 
of S,. The orthogonal complement of a subspace of R” is itself a subspace of R” (see 
Exercise 46). You can find the orthogonal complement of a subspace of R” by finding 
the nullspace of a matrix, as illustrated in Example 3. 


LINEAR The least squares problem has a wide variety of real-life 

ALGEBRA applications. To illustrate, Examples 9 and 10 and Exercises 
39, 40, and 41 are all least squares analysis problems, 

APPLIED and they involve such diverse subject matter as world 
population, astronomy, master’s degrees awarded, 
company revenues, and galloping speeds of animals. In 
each of these applications, you are given a set of data and 
you are asked to come up with mathematical model(s) for 
the data. For example, in Exercise 40, you are given the 
annual revenues from 2008 through 2013 for General 
Dynamics Corporation. You are asked to find the least 
squares regression quadratic and cubic polynomials for 
the data, to predict the revenue for the year 2018, and to 
decide which of the models appears to be more accurate 
for predicting future revenues. 


Loskutnikov/Shutterstock.com 
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EXAMPLE 3 Finding the Orthogonal Complement 


Find the orthogonal complement of the subspace S of R4 spanned by the two column 
vectors v, and v, of the matrix A. 


1 0 

2; 0 

amii i 

0 1 

Yi; Vo 
SOLUTION 


A vector u € R* is in the orthogonal complement of S when its dot product with each 
of the columns of A, v, and v,, is zero. So, the orthogonal complement of S consists of 
all the vectors u such that Au = 0. 


Au =0 
xy 
} 2 1 esje] 
o 0o © ıilx| Lo 
X4 


That is, the orthogonal complement of S is the nullspace of the matrix AT: 
S+ = N(A*). 


Using the techniques for solving homogeneous linear systems, you can find that a basis 
for the orthogonal complement consists of the vectors 


u,;=[-2 1 0 OJ]? and w=[|-1 0 1 OF. a 
Notice that R4 in Example 3 is split into two subspaces, S = span{v,, v>} and 
SŁ = span{u,, u,}. In fact, the four vectors v,, v>, u,, and u, form a basis for R*. Each 


vector in R* can be uniquely written as a sum of a vector from S and a vector from S+. 
The next definition generalizes this concept. 


Definition of Direct Sum 


Let S$, and S, be two subspaces of R”. If each vector x E R” can be uniquely 


written as a sum of a vector s, from S, and a vector s, from S,,x = s, + $5, then 
R” is the direct sum of S, and S, and you can write R” = S, BS. 


EXAMPLE i Direct Sum 


a. From Example 2, R° is the direct sum of the subspaces 


1} | 1 =1 
Sı = spany| 0}, } 1 and S, = span 1 
1] |0 1 
b. From Example 3, you can see that R4 = S®S+, where 

1] |0 =2] = 

E 0 o 1l] o 

S = span itlo and S+ = span obla 

ofli ojl o ui 
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The next theorem lists some important facts about orthogonal complements and 
direct sums. 


THEOREM 5.13 Properties of Orthogonal Subspaces 


Let S be a subspace of R”. Then the properties listed below are true. 


1. dim(S) + dim(S+) = n 
2. R” = SẸ St 
3. (S+)+ = 


PROOF 


1. If S = R” or S = {0}, then Property 1 is trivial. So let {v,, V», . . ., V,} be a basis 
for S,0 < t < n. Let A be the n x t matrix whose columns are the basis vectors v;. 
Then S = R(A) (the column space of A), which implies that S+ = N(AT), where AT 
is at x n matrix of rank t (see Section 5.3, Exercise 69). The dimension of N(AT) is 
n — t, so you have shown that 


dim(S) + dim(S+) = t+ (n- t =n. 


2. If S= R” or S= {0}, then Property 2 is trivial. So let {v,,v,,...,v,} 
be a basis for S and let {v,,,,V,,....+,V,} be a basis for S+. The set 
{Vo Vo. + -s Vo Vyp- + -> WY is linearly independent and forms a basis for R”. 
(Verify this.) Let x E R", x =cyvy, +--+ + eV, + ¢,41V,4, Tte °° + ¢,N,. If 
you write v = cV; +: + + + ew, and W =c¢,,,V,,, +: + + + ¢,Vv,. then you have 
expressed an arbitrary vector x as the sum of a vector from S$ and a vector from S+, 
x=vtw. 


To show the uniqueness of this representation, assume x = v + w = Ŷ + ŵŴ 
(where Ŷ is in S and W is in S+). This implies that ¥ — v = w — W. The two 
vectors § — v and w — Ware in both S and S+, and SN S+ = {0}. So, you must 
have ¥ = v and w = W. 


3. Let v E S. Then v > u = 0 for all u E S+, which implies that v E€ (S+)+. On the 
other hand, let v E€ (S+)+. Then v E€ R” = SẸ SŁ, so you can write v as the unique 
sum of a vector s from S and a vector w from S+, v = s + w. The vector w is in S+, 
so it is orthogonal to every vector in S, and also to v. So, 


v 
v 


0O=w-v=w-(st+w)=west+wrw=wew. 


This implies that w = Oandv=s+w=seE5S. | 


You studied the projection of one vector onto another in Section 5.2. This is now 
generalized to projections of a vector v onto a subspace S. R” = SẸ® S+, so every 
vector v in R” can be uniquely written as a sum of a vector from S and a vector from S+: 


v=v +v, WES, v E St. 


The vector v, is the projection of v onto the subspace S, and is denoted by v, = proj.v. 
So, v, = v — Vv, = V — proj,v, which implies that the vector v — proj,v is orthogonal 
to the subspace S. 

Given a subspace S' of R”, you can apply the Gram-Schmidt orthonormalization 
process to find an orthonormal basis for S. You can then find the projection of a vector 
v onto S using the next theorem. (You are asked to prove this theorem in Exercise 47.) 


THEOREM 5.14 Projection onto a Subspace 


If {u,, i s+ u} is an orthonormal basis for the subspace S of R”, and v E R”, 
then 


proj,v = (v-u,ju, + (ve uu, +---+ (ve uu, 
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x Projsv 
Figure 5.17 
Vv 1V — projyv 
projuV u 


1V — projsv 


Figure 5.18 
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EXAMPLE 5 j Projection Onto a Subspace 


1 
Find the projection of the vector v = | 1 | onto the subspace S of R? spanned by the vectors 
3 
0 2 
w =|3] and w,=|0}. 
1 0 
SOLUTION 
By normalizing w, and w, you obtain an orthonormal basis for S. 
0 
1 1 eu 
{u Uy} = 75" wo} = n > f 


J10 


Use Theorem 5.14 to find the projection of v onto S. 


(0) l 1 
projsv = (v ° uu; + (v ° u, )u, = $. =z +110] = 9 
/10| v10 N 5 
A 3 
J10 5 
Figure 5.17 illustrates the projection of v onto the plane S. | 


Theorem 5.9 states that among all the scalar multiples of a vector u, the orthogonal 
projection of v onto u is the one closest to v. Example 5 suggests that this property 
is also true for projections onto subspaces. That is, among all the vectors in the 
subspace S, the vector proj,v is the closest vector to v. Figure 5.18 illustrates these 
two results. 


THEOREM 5.15 Orthogonal Projection and Distance 


Let S be a subspace of R” and let v © R”. Then, for all u © S, u ¥ proj.v, 


lv — projsy|] < |lv — ul. 


PROOF 


Let u € S, u # proj,v. By adding and subtracting the same quantity proj,v to and from 
the vector v — u, you obtain 


v — u = (v — proj.v) + (proj.v — u). 


Observe that (proj,v — u) is in S and (v — proj,v) is orthogonal to S. So, (v — proj,v) 
and (proj;v — u) are orthogonal vectors, and you can use the Pythagorean Theorem 
(Theorem 5.6) to obtain 


lv — ul? = |lv — proj.v? + ||projsv — Wl. 
u # projcv, so ||proj;v — ul}? is positive, and you have 


lv — projsvl| < [lv — ull. Ll 
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Chapter 5 


Inner Product Spaces 


FUNDAMENTAL SUBSPACES OF A MATRIX 


Recall that if A is an m x n matrix, then the column space of A is a subspace of R” 
consisting of all vectors of the form Ax, x € R”. The four fundamental subspaces of 
the matrix A are listed below (see Exercises 67 and 68 in Section 5.3). 


N(A) = nullspace of A N(A‘) = nullspace of AT 
R(A) = column space of A R(AT) = column space of AT 


These subspaces play a crucial role in the solution of the least squares problem. 


EXAMPLE 6 | Fundamental Subspaces 


Find the four fundamental subspaces of the matrix 


2 0 


oo Co E a 
oo © 


1 
ol 
0 


SOLUTION 


The column space of A is simply the span of the first and third columns, because the 
second column is a scalar multiple of the first column. The column space of A” is equal 
to the row space of A, which is spanned by the first two rows. The nullspace of A is a 
solution space of the homogeneous system Ax = 0. Finally, the nullspace of A’ is a 
solution space of the homogeneous system whose coefficient matrix is A’. A summary 
of these results is shown below. 


ils 1] fo 
R(A) = span oblo R(AT) = spanį | 2 |, | 0 
1 
ollo 9 
-2 allo 
N(A) = span 1 N(AT) = span ielo 
olli 


In Example 6, observe that R(A) and N(AT) are orthogonal subspaces of R4, and 
R(AT) and N(A) are orthogonal subspaces of R?. These and other properties of the four 
fundamental subspaces are stated in the next theorem. 


THEOREM 5.16 Fundamental Subspaces of a Matrix 


If A isan m x n matrix, then 
1. R(A) and NA‘) are orthogonal subspaces of R”. 


2. R(AT) and N(A) are orthogonal subspaces of R”. 
3. R(A)Ð N(AT) = R”. 
4. R(AT)ÐN(A) = R”. 


PROOF 
To prove Property 1, let v E R(A) and u € N(A7). The column space of A is equal to 
the row space of A’, so ATu = 0 implies u + v = 0. Property 2 follows from applying 
Property 1 to A’. 

To prove Property 3, observe that R(A)+ = N(A7) and R” = R(A)@R(A)-. 
So, R” = R(A) ®N(A"). A similar argument applied to R(A7) proves Property 4. {jj 
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SOLVING THE LEAST SQUARES PROBLEM 


You have now developed all the tools needed to solve the least squares problem. Recall 
that you are attempting to find a vector x that minimizes ||Ax — b||, where A is an 
m x n matrix and b is a vector in R”. Let S be the column space of A: S = R(A). 


b Assume that b is not in S, because otherwise the system Ax = b would be consistent. 
You are looking for a vector Ax in S that is as close as possible to b, as illustrated in 
ae Figure 5.19. 
From Theorem 5.15, you know that the desired vector is the projection of b onto S. 
S So, Ax = projsb and Ax — b = projsb — b is orthogonal to S = R(A). However, this 
Figure 5.19 implies that Ax — b is in R(A)+, which equals N(A’). This is the crucial observation: 
` Ax — b is in the nullspace of A’. So, you have 
A™(Ax — b) = 0 
ATAx — Ab = 0 
ATAx = A'b. 


The solution of the least squares problem comes down to solving the n x n linear 
system of equations ATAx = A’b. These equations are the normal equations of the 
least squares problem Ax = b. 


EXAMPLE 7 Finding the Least Squares Solution 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


Find the solution of the least squares problem 


Ax=b 
1 0 
Aa 
ape 
from Example 1. 


SOLUTION 
Begin by finding the matrix products below. 


1 1 
1 1 1 3 6 
ata =| Me af- 48] 
1 2 31), 3 6 14 
0 
1 1 1 4 
Th = = 
as li 2 J pi 


The normal equations are represented by the system 


ATAx = A’b A 


lo alle }=Lik i 


The solution of this system of equations is 


n 


which implies that the least squares regression 
line for the data is y = -3 F 3x, as shown in 
the figure. 


NIY Win 
| 
ja N 
| | 
T T 
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For an m x n matrix A, the normal equations form an n x n system of linear 
equations. This system is always consistent, but it may have infinitely many solutions. 
It can be shown, however, that there is a unique solution when the rank of A is n. 

The next example illustrates how to solve the projection problem from Example 5 
using normal equations. 


EXAMPLE 8 Orthogonal Projection Onto a Subspace 


Find the orthogonal projection of the vector 


0 2 
A=|3 0}. 
1 0 
SOLUTION 
To find the orthogonal projection of b onto S, first solve the least squares problem 
Ax =b. 


As in Example 7, find the matrix products ATA and A’b. 


0 2 

0 3 1 
ata =| |p 0 
2 0 Ol), 0 


The normal equations are represented by the system 


ATAx = A'b 
[e aE 
0 4 |x, 2) 


The solution of these equations is 


Finally, the projection of b onto S is 
0 2 
Ax = 1/3 0 | 


which agrees with the solution obtained in Example 5. m 


b 
II 
vw an = 
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MATHEMATICAL MODELING 


Least squares problems play a fundamental role in mathematical modeling of real-life 
phenomena. The next example shows how to model the world population using a least 
squares quadratic polynomial. 


EXAM PLE 9 World Population 


The table shows the world population (in billions) for six different years. (Source: U.S. 
Census Bureau) 


1985 
4.9 


1990 
53 


1995 2000 2005 2010 
S 6.1 6.5 6.9 


Year 


Population, y 


Let x = 5 represent the year 1985. Find the least squares regression quadratic 
polynomial y = cy + cx + cx? for the data and use the model to estimate the 
population for the year 2020. 


SOLUTION 


By substituting the data points (5, 4.9), (10, 5.3), (15, 5.7), (20, 6.1), (25, 6.5), and 
(30, 6.9) into the quadratic polynomial y = cy + cx + c,x?, you obtain the system of 
linear equations below. 


Co t 5c + 25c, = 4.9 
Co + 10c, + 100c, = 5.3 
co + 15c, + 225c, = 5.7 
Co + 20c, + 400c, = 6.1 
Co + 25c, + 625c, = 6.5 
Co + 30c, + 900c, = 6.9 


This produces the least squares problem 


Ax=b 
1 5 25 4.9 
1 10 100 53 
1 15 225|] [5.7 
1 20 40|7|61 
1 25 625 (E2165 
1 30 900 6.9 


The normal equations are represented by the system 


ATAx = Ab 
6 105 2275 || co 35.4 
105 2275 55,125 || c, | = 654.5 
2275 55,125 1,421,875 || c 14,647.5 
Co 4.5 
and their solution is x = | c, | = | 0.08 |. 
Cy 0 


Note that c, = 0. So, the least squares polynomial is the linear polynomial 
y = 4.5 + 0.08x. Evaluating this polynomial at x = 40 gives the estimate of the world 
population for the year 2020: y = 4.5 + 0.08(40) = 7.7 billion. 
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Least squares models can arise in many other contexts. Section 5.5 explores some 
applications of least squares models to approximations of functions. The next example 
uses data from Section 1.3 to find a nonlinear relationship between the period of a planet 
and its mean distance from the Sun. 


DENI ESSt Application to Astronomy 


The table shows the mean distances x and the periods y of the six planets that are closest 
to the Sun. The mean distances are in astronomical units and the periods are in years. 
Find a model for the data. 


Planet Mercury Venus Earth Mars Jupiter Saturn 
0.387 0.723 1.000 1.524 5.203 9.537 


0.241 0.615 1.000 1.881 11.862 29.457 


Distance, x 


Period, y 


SOLUTION 


When you plot the data as given, they do not lie in a straight line. By taking the 
natural logarithm of each coordinate, however, you obtain points of the form (In x, In y), 
TECHNOLOGY e y P olay 


as shown below. 
You can use a graphing utility 
or software program to verify 


thë result of Example 10. For Planet | Mercury Venus Earth Mars Jupiter Saturn 
instance, using the data in In x —0.949  —0.324 0.0 0.421 1.649 2.255 

the first table, a graphing 

utility gives a power regression Iny — 1.423 —0.486 0.0 0.632 2.473 3.383 

model of y = 1.00029x1-49972, 

The Technology Guide at A plot of the transformed points suggests that the least squares regression line 
CengageBrain.com can help would be a good fit. 


you use technology to model 
data. 


Saturn 


Jupiter 


Use the techniques of this section on the system 


Co — 0.949¢c, = — 1.423 
Co — 0.324c, = — 0.486 
Co = 0.0 


Co + 0.421c, = 0.632 
Co + 1.649c, = 2.473 
Cy F 2.255¢ 3.383 


to verify that the equation of the line is 


Iny=3Inx or y= x2, u 
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5.4 Exercises 


Least Squares Regression Line In Exercises 1-4, 
determine whether the points are collinear. If so, find the 
line y = cy + c,x that fits the points. 


Orthogonal Subspaces In Exercises 5-8, determine 
whether the subspaces are orthogonal. 


3} |0 2 
5. S; = span 2|,) 1 S, = spany| —3 
—2]} [0 0 
=3 2} |0 
6. S; = span 0 S, = spany| 1}, | 1 
1 6 
1 =] 0 
1 1 2 
7. S; = span l S, = span —1bl-2 
1 1 0 
0 0 3 0 
0 0 2 1 
8. S; = span abl 4 S, = span oll —2 
£] |=2 0 2 


Finding the Orthogonal Complement and Direct 
Sum In Exercises 9-14, (a) find the orthogonal 
complement S+, and (b) find the direct sum S @S+. 


0} | 2 0 
9. S = span au 10. S = span, | —2 
1 1 
0 
1 
11. S = span I 
0 0; |2 
1 1 0 
12. S = span} | —1 |, 0j, |1 
1 2) 10 
= —1 2 


13. S is the subspace of R? consisting of the xz-plane. 


14. S is the subspace of R° consisting of all vectors whose 
third and fourth components are zero. 


15. Find the orthogonal complement of the solution of 
Exercise 11(a). 


16. Find the orthogonal complement of the solution of 
Exercise 12(a). 


See CalcChat.com for worked-out solutions to odd-numbered exercises. 


5.4 Exercises 


Sm 


Projection Onto a Subspace In Exercises 17-20, find 
the projection of the vector v onto the subspace S. 


010 1 

OJ | 1 0 
17. S = span blip y= 

Ei i 1 

—1]]0] }0 1 

2} 10/10 1 
18. S = span obliklolt Y= 

0; |O;} }1 1 

1 2 
19. S = span;|0},} 1] 7, v=]3 

1} | 1 4 

1 0} |0 1 

1 1} | 1 2 
20. S = span elibat v= 3 

1 0| |0 4 


Fundamental Subspaces In Exercises 21-24, find 
bases for the four fundamental subspaces of the matrix A. 


0 =l 1 

21. A= p 7 ;| 22. A=|1 2 0 
1 1 1 

1 0 0 1 0 =1 

0 1 1 0 1 1 

23. A = l l l 24. A = l l 0 
1 2 2 1 0 1 


Finding the Least Squares Solution In Exercises 
25-28, find the least squares solution of the system Ax = b. 


2 1 2 
25. A=|1 2 b=] 0 
1 1 =3 
1 1 1 2 
1 1 1 1 
26. A = 0 i 1 b= 0 
1 0 1 2 
1 0 1 4 
1 1 1 =] 
27. A = 0 1 1 b= 0 
1 1 0 1 
0 2 1 1 
1 1 =1 0 
28. A =| 2 1 0 b= 1 
1 1 1 =] 
0 2. =] 0 
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Orthogonal Projection Onto a Subspace In Exercises 
29 and 30, use the method of Example 8 to find the 
orthogonal projection of b=[2 -—2 1]? onto the 
column space of the matrix A. 


1 2 0 2 
29. A= |0 1 30. A=] 1 1 
1 1 1 3 


Finding the Least Squares Regression Line In 
Exercises 31-34, find the least squares regression line 
for the data points. Graph the points and the line on the 
same set of axes. 


31. (—1, 1), (1, 0), (3, —3) 

32. (1, 1), (2, 3), (4, 5) 

33. (—2, 1), (—1, 2), (0, 1), (1, 2), (2, 1) 
34. (—2, 0), (—1, 2), (0, 3), (1, 5), (2, 6) 


Finding the Least Squares Quadratic Polynomial In 
Exercises 35-38, find the least squares regression 
quadratic polynomial for the data points. 


35. (0, 0), (2, 2), (3, 6), (4, 12) 

36. (0, 2), (1, 3), (2, 3), G. 4) 

37. (—2, 0), (= 1, 0), (0, 1), (1, 2), (2, 5) 
38. (—2, 6), (—1, 5), (0, 3), (1, 2), (2, — 1) 


©». Master's Degrees The table shows the numbers 


of master’s degrees y (in thousands) conferred in the 
United States from 2009 through 2012. Find the least 
squares regression line for the data. Then use the model 
to predict the number of degrees conferred in 2019. Let t 
represent the year, with t = 9 corresponding to 2009. 
(Source: U.S. National Center for Education Statistics) 


Year 2009 2010 2011 2012 
Master’s | 6691 693.0 730.6 754.2 
Degrees, y 


(=) 40. Revenue The table shows the revenues y (in billions 


of dollars) for General Dynamics Corporation from 2008 
through 2013. Find the least squares regression quadratic 
and cubic polynomials for the data. Then use each model 
to predict the revenue in 2018. Let ¢ represent the year, 
with t = 8 corresponding to 2008. Which model appears 
to be more accurate for predicting future revenues? 
Explain. (Source: General Dynamics Corporation) 


2008 2009 2010 
293 32.0 32.5 


Year 


Revenue, y 


2011 2012 2013 
32.7 31.7 31.2 


Year 


Revenue, y 


41. Galloping Speeds of Animals Four-legged animals 
run with two different types of motion: trotting and 
galloping. An animal that is trotting has at least one foot 
on the ground at all times, whereas an animal that is 
galloping has all four feet off the ground at some point 
in its stride. The number of strides per minute at which 
an animal breaks from a trot to a gallop depends on the 
weight of the animal. Use the table and the method of 
Example 10 to find an equation that relates an animal’ s 
weight x (in pounds) and its lowest galloping speed y 
(in strides per minute). 


Weight, x 25 35 50 
Galloping Speed, y | 191.5 182.7 173.8 
Weight, x 75 500 1000 
Galloping Speed, y | 164.2 125.9 114.2 


42. CAPSTONE Explain how orthogonality, 
orthogonal complements, the projection of a 


vector, and fundamental subspaces are used to 
find the solution of a least squares problem. 


True or False? In Exercises 43 and 44, determine 
whether each statement is true or false. If a statement 
is true, give a reason or cite an appropriate statement 
from the text. If a statement is false, provide an example 
that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


43. (a) The orthogonal complement of R” is the empty set. 
(b) If each vector v E R” can be uniquely written as a 


sum of a vector s, from S, and a vector s, from S,, 
then R” is the direct sum of S, and S,. 
44. (a) If A is an m x n matrix, then R(A) and N(A’) are 
orthogonal subspaces of R”. 
(b) The set of all vectors orthogonal to every vector in 
a subspace S is the orthogonal complement of S. 


(c) Given an m x n matrix A and a vector b in R”, the 
least squares problem is to find x in R” such that 
||Ax = bl}? is minimized. 


45. Proof Prove that if S, and S, are orthogonal subspaces 
of R”, then their intersection consists of only the zero 
vector. 


46. Proof Prove that the orthogonal complement of a 
subspace of R” is itself a subspace of R”. 


47. Proof Prove Theorem 5.14. 
48. Proof Prove that if S| and S, are subspaces of R” and if 


R” = S OS, 
then 
Si N S, = {0}. 
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5.5 Applications of Inner Product Spaces 


REMARK 


The cross product is defined 
only for vectors in R3. The 
cross product of two vectors in 
R”, n # 3, is not defined here. 


Find the cross product of two vectors in R?. 


Find the linear or quadratic least squares approximation of 
a function. 


Find the nth-order Fourier approximation of a function. 


THE CROSS PRODUCT OF TWO VECTORS IN R? 


Here you will look at a vector product that yields a vector in R° orthogonal to two 
vectors. This vector product is called the cross product, and it is most conveniently 
defined and calculated with vectors written in standard unit vector form 


v = (vi, V» V3) = vii + vj + vk. 


Definition of the Cross Product of Two Vectors 


Let u = u,i + uj + uk and v = v;i + v,j + v3k be vectors in R?. The cross 
product of u and v is the vector 


u x v = (uv; — uzvi — (uv; — uzvi)j + (uv, — uv, )K. 


A convenient way to remember the formula for the cross product u x v is to use 
the determinant form below. 


ij k 
uxv=ļ|uų %U Uy; << Components of u 
vu V2 V3 << Components of v 


Technically this is not a determinant because it represents a vector and not a real 
number. Nevertheless, it is useful because it can help you remember the cross product 
formula. Using cofactor expansion in the first row produces 


Uy Uy 


uxv k 


j+ 


Vo V3 vı V3 Vy 12) 


= (u,v, — uzvi — (uv, — uzvi)j + (uiv, — uv, )k 


which yields the formula in the definition. Be sure to note that the j-component is 
preceded by a minus sign. 


LINEAR In physics, the cross product can be used to measure 

ALGEBRA torque—the moment M of a force F about a point A, as 
shown in the figure below. When the point of application 

APPLIED of the force is B, the moment of F about A is 


M = AÈ x F 


where AB represents the 
vector whose initial point is 
A and whose terminal point 
is B. The magnitude of the 
moment M measures the 
tendency of AB to rotate 
counterclockwise about 

an axis directed along the 
vector M. 


mark cinotti/Shutterstock.com 
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TECHNOLOGY EXAMPLE 1 Finding the Cross Product of Two Vectors 
Many graphing utilities and 


software programs can find a Let u = i — 2j + k and v = 3i + j — 2k. Find each cross product. 
cross product. For instance, if 
you use a graphing utility to auxv bvxu avxv 
verify the result of Example 1(b), 
then you may see something SOLUTION 
similar to the screen below. $ ; 
i j k 
VECTOR:U auxv=|l -2 1 
e1=1 3 1 -2 
=2 1 1 1 -2 
_ Ae PEN 
i <3) k i F k 
= 3i + 5j + 7k 
cross(V,U) 
i j k 
b. vx u= j3 1 =2 
| =2 1 
1 =2 3. =2 3 1 
_ . oo 
=) A l i f hk 
= —3i — 5j — 7k 
Note that this result is the negative of that in part (a). 
i j k 
e VXVv= [3 1 =2 
3 I =2 
|] =2._ j3 =2. , |3 lk 
1 -27 re a 1 
= 0i + 0j + 0k = 0 m 


The results obtained in Example 1 suggest some interesting algebraic properties of 
the cross product. For instance, 


uxv=-(vyvxu) and vxv=0. 


Theorem 5.17 states these properties along with several others. 


THEOREM 5.17 Algebraic Properties of the Cross Product 


If u, v, and w are vectors in R? and c is a scalar, then the properties listed below 
are true. 


.uxv=-—(vxu) 


. u x (v + w) = (u x v) + (u x w) 
. cu xv) = cux v=ux cv 
~-uxd0=0xu=0 

-uxu=0 

.ue(vx w)=(uxv)ew 


PROOF 


The proof of the first property is given here. The proofs of the other properties are left 
to you. (See Exercises 55-59.) Let u and v be 


u = wit uj + uk 
and 


v= vi + vj + vk. 
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Then u x vis 
i j k 
uxv={u, Uy Uy 
vı Vo V3 


= (u,v; — U3V>)i — (uv; — u3V,)j + (uiv) — uvi)k 
and v x wis 
i j k 
vxu=|y, v» 3 
u uw č i} 


= (vau V3Uy)i (viu = vzu,)j F (viu z vu, )k 


= — (u,v; — uvi + (uv; — uzv;)j — (uiv, — uv, )k 


= —(y xu). 


Property 1 of Theorem 5.17 tells you that the vectors u x v and v x u have equal 
lengths but opposite directions. The geometric implication of this will be discussed 
after establishing some geometric properties of the cross product of two vectors. 


THEOREM 5.18 Geometric Properties of the Cross Product 


If u and v are nonzero vectors in R°, then the properties listed below are true. 


1. u x v is orthogonal to both u and v. 
The angle @ between u and v is found using |lu x v|| = [lul] ||v| sin 6. 


2. 
3. u and v are parallel if and only if u x v = 0. 
4. The parallelogram having u and v as adjacent sides has an area of ||u x vl]. 


PROOF 


The proof of Property 4 is presented here. The proofs of the other properties are left to 
you. (See Exercises 63—65.) Let u and v represent adjacent sides of a parallelogram, as 
shown in Figure 5.20. By Property 2, the area of the parallelogram is 


Base Height 
a e 


Area = |lul)||v|| sin @ = |lu x vl. m 


Figure 5.20 


Property 1 states that the vector u x v is orthogonal to both u and v. This implies 
that u x v (and v x u) is orthogonal to the plane determined by u and v. One way to 
remember the orientation of the vectors u, v, and u x v is to compare them with the unit 
vectors i, j, and k, as shown below. The three vectors u, v, and u x v form a right-handed 
system, whereas the three vectors u, v, and v x u form a left-handed system. 


This is the plane 
determined by 
u and v. 


Right-Handed 
Systems 
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$ Finding a Vector Orthogonal 
EXAMPLE 2 to Two Given Vectors 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


Find a unit vector orthogonal to both 


u=i-4j+k 
and 
v = 2i + 3j. 
SOLUTION 
A From Property 1 of Theorem 5.18, you know that the cross product 
ph ©3.2, 1) . . 
i j k 
uxv=/l —4 1) = —3i + 2j + 11k 
2 3 0 
is orthogonal to both u and v, as shown in Figure 5.21. Then, by dividing by the length 
ofu x v, 
eee | lux vl = VCF + 2 + IP = /134 
í you obtain the unit vector 
v uxv 3 it 2 $ 11 
Juxvl Ba Visa)” 7134 


= 4 
(2,3, 0) 
which is orthogonal to both u and v, because 
(- 3 2 H 
J134 J134 ./134 


Figure 5.21 


J-a, 4,1)=0 


and 


3 2 11 
> > ? 2,3,0 = 0. 
( J134 134 aaa) ( ) ui 


, EXAMPLE 3 Finding the Area of a Parallelogram 
v=—2j+ 6k 


Find the area of the parallelogram that has 


u = —3i + 4j +k 
and 
v = —2j + 6k 
as adjacent sides, as shown in Figure 5.22. 


SOLUTION 


From Property 4 of Theorem 5.18, you know that the area of this parallelogram is 
Bo |lu x y||. The cross product is 


u=>3i+4j +k i j k 


uxv=]|-3 4 1| = 26i + 18j + 6k. 
07 =2 6 
The area of the parallelogram is . 
ilu x vl] = v1036. So, the area of the parallelogram is 
Figure 5.22 ju x vi] = /262 + 182 + 62 = ./1036 = 32.19 square units. m 
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LEAST SQUARES APPROXIMATIONS (CALCULUS) 


Many problems in the physical sciences and engineering involve an approximation of 
a function f by another function g. If f is in Cla, b] (the inner product space of all 
continuous functions on [a, b]), then g is usually chosen from a subspace W of C[a, b]. 
For example, to approximate the function 


fi =e,0<x<1 


you could choose one of the forms of g listed below. 


1. g(x) =ag tax, Osxsl Linear 
2. g(x) =a, + ax + ax, Ofx=1 Quadratic 
3. g(x) =a) + a cosx + a sinx, 0O<sx<l Trigonometric 


Before discussing ways of finding the function g, you must define how one 
function can “best” approximate another function. One natural way would require the 
area bounded by the graphs of f and g on the interval [a, b], 


Area = | | f(x) — g(x)| dx 


to be a minimum with respect to other functions in the subspace W, as shown below. 


Integrands involving absolute value are often difficult to evaluate, however, so it is 
more common to square the integrand to obtain 


i Ty) — ela) a. 


With this criterion, the function g is the least squares approximation of f with respect 
to the inner product space W. 


Definition of Least Squares Approximation 


Let f be continuous on [a, b], and let W be a subspace of C[a, b]. A function g in 
W is the least squares approximation of f with respect to W when the value of 


i= f [f(x) — g(a) P dx 


is a minimum with respect to all other functions in W. 


Note that if the subspace W in this definition is the entire space Cla, b], then 
g(x) = f(x), which implies that J = 0. 
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Figure 5.23 


Inner Product Spaces 


EXAMPLE 4 Finding a Least Squares Approximation 


Find the least squares approximation g(x) = dy + a,x of 
fx) =e, OSx1. 
SOLUTION 


For this approximation, you need to find the constants a, and a, that minimize the value of 


1 
1= [Lie = ew a 
M1 
= f (e* — day — ax} dx. 
0 
Evaluating this integral, you have 
1 
I= f (= ay — a,x)? dx 
0 
1 
= [ (e?* = 2aye* = 2a,xe* + az + 2apa,x + aix?) dx 
0 


1 Pk 
= se — 2ape* — eu = 1) + ałx + ayax? + az 


1 1 
= ze — 1) — 2a(e — 1) — 2a, + a? + aga, + 3a: 


Now, considering / to be a function of the variables a, and a,, use calculus to determine 
the values of ay and a, that minimize I. Specifically, by setting the partial derivatives 


ol 

—— = 2a, — 2e $2.4 a, 
ða 

ol 2 

A = a + z^ 2 


equal to zero, you obtain the two linear equations in a, and a, below. 
2a + a, = 2(e — 1) 
3d) + 2a, = 6 
The solution of this system is 
dy = 4e — 10 ~ 0.873 and a, = 18 — 6e = 1.690. 
(Verify this.) So, the best linear approximation of f(x) = e* on the interval [0, 1] is 
g(x) = 4e — 10 + (18 — 6e)x ~ 0.873 + 1.690x. 
Figure 5.23 shows the graphs of f and g on [0, 1]. m 


Of course, whether the approximation obtained in Example 4 is the best 
approximation depends on the definition of the best approximation. For instance, if 
the definition of the best approximation had been the Taylor polynomial of degree 1 
centered at 0.5, then the approximating function g would have been 


g(x) = f(0.5) + f'(0.5)(x — 0.5) 
= e®5 + e®5(x — 0.5) 
=~ 0.824 + 1.649x. 
Moreover, the function g obtained in Example 4 is only the best linear approximation 


of f (according to the least squares criterion). In Example 5 you will find the best 
quadratic approximation. 
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EXAMPLE 5 Finding a Least Squares Approximation 


Find the least squares approximation g(x) = dy + a,x + a,x? of f(x) = e*,0 < x < 1. 
SOLUTION 


For this approximation you need to find the values of a, a}, and a, that minimize the 
value of 


I= [tr — g(x) P dx 


1 

= f (e — dy ajs — ayx?)? dx 
0 

ai 


= (eo — 1) 2a. — e) + 2a,(2 — e) 


2 
+ ai + aga PE + rajas + e+ Lp 2a 
0 ail 3 02 9 1%2 3 1 5 2, 1: 
g(x) = 1.013 + 0.851x + 0.839x? Setting the partial derivatives of J (with respect to dy, a}, and a) equal to zero produces 

the system of linear equations below. 

6a) + 3a, + 2a, = 6(e — 1) 

6a) + 4a, + 3a, = 12 

20a, + 15a, + 12a, = 60(e — 2) 


(Verify this.) The solution of this system is 
dy = —105 + 39e = 1.013 


i >x ad, = 588 — 216e ~ 0.851 
1 


x)=e 


(Verify this.) So, the approximating function g is g(x) = 1.013 + 0.851x + 0.839x?. 
Figure 5.24 Figure 5.24 shows the graphs of f and g on [0, 1]. 


The integral Z given in the definition of the least squares approximation can be 
expressed in vector form. To do this, use the inner product defined in Example 5 in 
Section 5.2: 


b 
(fa) = i f(x)g(x) dx. 


With this inner product you have 


[= i [f(x) — gP dx = (f-— 8. f-— 8) = (lf - elf. 


This means that the least squares approximating function g is the function that 
minimizes ||f — g|? or, equivalently, minimizes ||f — g||. In other words, the least 
squares approximation of a function f is the function g (in the subspace W) closest to 
f in terms of the inner product ( f, g}. The next theorem gives you a way of determining 
the function g. 


THEOREM 5.19 Least Squares Approximation 


Let f be continuous on [a, b], and let W be a finite-dimensional subspace of C[a, b]. 
The least squares approximating function of f with respect to W is 


g = (F WYW + (f WoW. ++ > > + (F W) W, 


where B = {w,, W5,. . ., W,} is an orthonormal basis for W. 
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ad 


Chapter 5 


Figure 5.25 


Inner Product Spaces 


PROOF 


To show that g is the least squares approximating function of f, prove that the inequality 
If — all < ||, — wll is true for any vector w in W. Writing f — g as 


f= 2 =f SEW Ea es OD, 


shows that f — g is orthogonal to each w,, which in turn implies that it is orthogonal to 
each vector in W. In particular, f — g is orthogonal to g — w. This allows you to apply 
the Pythagorean Theorem to the vector sum f — w = (f — g) + (g — w) to conclude 
that |f — wl = |f — gl? + |g — wll. So, it follows that |f — gl? < ||,f — wl?, which 
then implies that || f — gl| < || f— wll. 


Now observe how Theorem 5.19 can be used to produce the least squares 
approximation obtained in Example 4. First apply the Gram-Schmidt orthonormalization 
process to the standard basis {1, x} to obtain the orthonormal basis B = {1, \/3(2x — 1)}. 
(Verify this.) Then, by Theorem 5.19, the least squares approximation of e* in the subspace 
of all linear functions is 


g(x) = (e 1)(1) + (es, V3(2x — 1) /3(2x 1) 
= f e* dx + ./3(2x — Df /3e*(2x — 1) dx 


1 1 

= | easa- Df e*(2x — 1) dx 
0 0 

= 4e — 10 + (18 — 6e)x 


which agrees with the result obtained in Example 4. 


EXAMPLE 6 Finding a Least Squares Approximation 


Find the least squares approximation of f(x) = sin x, 0 < x < 7, with respect to the 
subspace W of polynomial functions of degree 2 or less. 


SOLUTION 


To use Theorem 5.19, apply the Gram-Schmidt orthonormalization process to the 
standard basis for W, {1, x, x7}, to obtain the orthonormal basis 


_ I. wf re 
B= {w; Wo, w3} = E ma z), m/n 


(Verify this.) The least squares approximating function g is 


a(x) = (f, Wi) Wi + (f, Wo)W + (f, W3) W3 


and you have 


(J, wW) = Jf sinxas = x 
(f, Wo) = SE f'sin x(2x — 2) dx = 0 


(6x? — 67x + 3). 


245 


(f, W3) = | sin x(6x? — 62x + n?) dx = ne — 12). 
So, g is 
oa 
g(x) = 2 + or 12) 6,2 6nx + n?) =~ —0.4177x2 + 1.3122x — 0.0505. 
Figure 5.25 shows the graphs of f and g. m 
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FOURIER APPROXIMATIONS (CALCULUS) 


You will now look at a special type of least squares approximation called a Fourier 
approximation. For this approximation, consider functions of the form 


a ; ; 
a(x) = > + a, cosx +: -++a,cosnx + b, sinx +--+ +b, sinnx 


in the subspace W of 
C[0, 27] 
spanned by the basis 
S = {1, cos x, cos 2x,. . ., cos nx, sin x, sin 2x,. . ., sin nx}. 


These 2n + 1 vectors are orthogonal in the inner product space C[0, 27] because 


(a) = | eoa 


=0, f#e 


as demonstrated in Example 3 in Section 5.3. Moreover, by normalizing each function 
in this basis, you obtain the orthonormal basis 


B = {Wo Wp. - © Wp Watts: + +s Wont 


cos x, COs NX, 


a Wa er sz sin. , “sin ns} 


With this orthonormal basis, you can apply Theorem 5.19 to write 


g(x) = (f Wo) Wo T (f, W))W, Ie (J, Won) Won- 
The coefficients 


Ap, E . »,4,,0,,. ..,5, 


for g(x) in the equation 
g(x) = 2+ a, cosx +--+ a,cosnx + b sinx +- -+ 5, sinnx 


are found using the integrals below. 


2 2 2r 1 o1 2r 
CS, Wo) Ta — 2f Bo = Lf f(x) dx 
i= MF = 4f —_ = f "0 cos x dx 


eeu: J| re f(x) pee GWS cos nx dx 
b= (f,w, ei sel reo f(x) ao fw sin x dx 


2r 2r 
b, = (fi Won) 7 = =| f(x) T sin nx dx = Lf f(x) sin nx dx 


The function g(x) is the nth-order Fourier approximation of f on the interval [0, 27]. 
Like Fourier coefficients, this function is named after the French mathematician 
Jean-Baptiste Joseph Fourier. This brings you to Theorem 5.20. 
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THEOREM 5.20 Fourier Approximation 


On the interval [0, 27], the least squares approximation of a continuous function 
f with respect to the vector space spanned by 


{l, cosx,. . ., cos nx, sinx,. . ., sin nx} 


= % 


> + a cosx +: -+ +a,cosnx + b sinx +--+ ++ b,sinnx 


where the Fourier coefficients a), a,,.. ., a 


1 27 
a= f(x) dx 


b,,. . .,b, are 


n? 


1 2m 
4-4] f(x) cos jxdx, j=1,2,...,n 
0 


1 27 
= 1/ f(x) sinjx dx, j= 1,2,...,n. 
T Jo 


EXAMPLE 7 Finding a Fourier Approximation 


Find the third-order Fourier approximation of f(x) = x,0 < x < 2x. 


SOLUTION 
Using Theorem 5.20, you have 


a : ‘ : 
g(x) = F + aj cosx + acos 2x + acos 3x + b; sinx + b, sin 2x + b, sin 3x 
where 


2n 
dp = ‘| xdx = Le = 2r 
1 


27 
1 2m 
y= 4 x cos jx dx =| cos je + “sin jx =0 
0 J 1J 0 


I eee en: core ae 
b=—| xsinjxdx =|—7 sin jx — —_cosjx| = =~. 
Tt Jo nj nj 0 j 
This implies that a) = 27, a, = 0, a, = 0, a, = 0, b, = —2, b, = —} = —1, and 


b, = -2 So, you have 


y 
g(x) =Z- 2sinx — sin 2x — Žsin 3x A El 


=n — 2 sinx — sin 2x — Ž sin 3x. 


The figure at the right compares the graphs 
of f and g. 


7 T 
Third-Order Fourier Approximation 
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g(x) =Z f cos x+ gh cos 3x 


Figure 5.26 
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In Example 7, the pattern for the Fourier coefficients is aj = 27, 
G4, =@=':-+=4 0, and 


n 


The nth-order Fourier approximation of f(x) = x is 
; La 1. l; 
g(x) = n — 2| sinx + 5 Sin 2x + 3 sin 3x +--+ z sin nx J. 


As n increases, the Fourier approximation improves. For example, the figures below 
show the fourth- and fifth-order Fourier approximations of f(x) = x,0 < x < 27. 


L 


Fourth-Order Fourier Approximation Fifth-Order Fourier Approximation 


In advanced courses it is shown that as n —> co, the approximation error ||f — gl| 
approaches zero. The infinite series for g(x) is a Fourier series. 


EXAMPLE 8 Finding a Fourier Approximation 


50 <x S 2n. 


Find the fourth-order Fourier approximation of f(x) = |x — x 


SOLUTION 


Using Theorem 5.20, find the Fourier coefficients as shown below. 


1 2n 
a= +{ |x — n| dx =n 
0 


1 2n 
a= +/ |x — z| cos jx dx 
i ah 


2 m 
= Í (x — x) cos jx dx 
T Jo 


2 
oe j= ; 
a cos jz) 
1 2r 
b, = f |x — z| sin jx dx 
i” atl, 
= 0 


So, dy = 1, a, = 4/7, a, = 0, a; = 4/(97), a, = 0, b; = 0, b, = 0, b, = 0, and 
b, = 0, which means that the fourth-order Fourier approximation of f is 


(x) = uae are + eee ay 
g 2 x On ` 


Figure 5.26 compares the graphs of f and g. ui 
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5.5 Exercises 


Finding the Cross Product In Exercises 1-6, find the 
cross product of the unit vectors [where i = (1, 0, 0), 
j = (0, 1, 0), and k = (0, 0, 1)]. Sketch your result. 


1. jxi 21x j 
3. j xk 4.kxj 
5.ixk 6. k xi 


Finding the Cross Product In Exercises 7-14, find 
(a) u x v, (b) v x u, and (c) v x v. 

7.u=i-j, v=j+k 

8. u = 2i+k, v=i+ 3k 


9 u=i+2j-k, v=i+j+2k 
10. u =i—j-— k, v= 2i + 2j + 2k 
11. u = (-1,-1,1), v= (—1,1,—1) 
12. u = (3, —3, —3), v = (3, —3, 3) 
13. u = (3, —2, 4), v = (1,5, —3) 

14. u = (—2,9, —3), v= (4,6, —5) 


Finding the Cross Product In Exercises 15-26, find 
u x v and show that it is orthogonal to both u and v. 


15. u = (0,1, —2), v= (1,—1,0) 
16. u = (-1,1,2), v= (0,1, —1) 


17. u = (12, —3, 1), v = (-2,5, 1) 

18. u = (—2, 1,1), v = (4,2,0) 

19. u = (2, —3, 1), v= (1, -2, 1) 

20. u = (4,1,0), v = (3,2, —2) 

21. u =j + 6k, v= 2i-— k 

22. u = 2i-jt+k, v=3i-j 

23. u =i+j+k, v=2i+j-k 

24. u =i- 2j+k, v= —i+ 3j — 2k 

25. u = 3i + 2j + 4k, v= 4i + 5j + 6k 

26. u = —5i + 19j — 12k, v = 5i — 19j + 12k 


PF Finding the Cross Product In Exercises 27-34, use a 


graphing utility to find u x v, and then show that it is 
orthogonal to both u and v. 


27. u = (1,2, -1), v= (2, 1, 2) 
28. u = (1,2,-3), v=(-1,1,2) 


29. u = (0,1,—1), v= (1,2,0) 

30. u = (2,0, —1), v= (—1,0,—4) 
31. u= —2i+j-k, v=-—i+2j-k 
32. u = 3i-j+k, v=2i+j-k 
33.u=2i+j-k, v=i-—j+ 2k 
34. u = 4i + 2j, v=i- 4k 


See CalcChat.com for worked-out solutions to odd-numbered exercises. 


JO 


Using the Cross Product In Exercises 35-42, find a 
unit vector orthogonal to both u and v. 


35. u = (—4, 3, —2) 36. u = (2, — 1, 3) 


v = (-1, 1,0) v = (1,0, —2) 

37. u = 31+ j 38. u =i + 2j 
v=j+k v =i-3k 

39. u = —3i + 2j — 5k 40. u = 7i — 14j + 5k 
v=5i-3j + $k v = 14i + 28j — 15k 

41.u=-i-jt+k 42. u =i — 2j + 2k 
v=i-j-k v=2i-j-2k 


Finding the Area of a Parallelogram In Exercises 
43-46, find the area of the parallelogram that has the 
vectors as adjacent sides. 


43.u=j, v=jt+k 
44.u=i-jt+k, v=i+k 
45. u = (3,2,-1), v= (1,2, 3) 
46. u = (2, —1,0), v= (—1,2,0) 


Geometric Application of the Cross Product In 
Exercises 47 and 48, verify that the points are the vertices 
of a parallelogram, and then find its area. 

47. (1, 1, 1), (2, 3, 4), (6, 5, 2), (7, 7, 5) 

48. (1, —2, 0), (4, 0, 3), (— 1, 0, 0), (2, 2, 3) 


Finding the Area of a Triangle In Exercises 49 and 50, 
find the area of the triangle with the given vertices. Use 
the fact that the area A of the triangle having u and v as 
adjacent sides is A = $||u x vl]. 

49. (3, 5; 7), (5; 5, 0), (=4, 0, 4) 

50. (2, =3, 4), (0, 1; 2), (= 1, 2, 0) 

Triple Scalar Product In Exercises 51-54, find 


u*(vxw). This quantity is called the triple scalar 
product of u, v, and w. 


5l.u=i, v=j, w=k 


52. u = —-i, v=—-j, w=k 
53. u = (3,3,3), v= (1,2,0), w= (0, -1,0) 
54. u = (2,0,1), v = (0,3,0), w= (0,0, 1) 


55. Proof Prove that u x (v + w) = (u x v) + (u x w). 
56. Proof Prove that c(u x v) = cu x v = u x cv. 

57. Proof Prove thatu x 0 = 0 x u = 0. 

58. Proof Prove that u x u = 0. 

59. Proof Prove that us (v x w) = (u x v) ° w. 

60. Proof Prove Lagrange’s Identity: 


lu x vl? = llulPlvP — (u + v}. 
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61. Volume of a Parallelepiped Show that the volume 
V of a parallelepiped having u, v, and w as adjacent 
edges is V = |u + (v x w)|. 

62. Finding the Volume of a Parallelepiped Use 
the result of Exercise 61 to find the volume of each 
parallelepiped. 


(a) u=it+j (b) u=it+j 
v=jt+k v=j+k 
w =i+ 2k w=i+k 


(c) u = (0, 2, 2) (d) u = (1,2, —1) 
v = (0,0, —2) v = (-1,2,2) 
w = (3, 0, 2) w = (2,0, 1) 
i 02,2) 


63. Proof Prove that u x v is orthogonal to both u and v. 
64. Proof Prove that the angle 0 between u and v is found 


using |lu x v|| = |lul]||v|| sin 8. 

65. Proof Prove that u and v are parallel if and only if 
uxv=0. 

66. Proof 


(a) Prove that 
u x (v x w) = (u* w)v — (u ° v)w. 
(b) Find an example for which 
u x (v x w) # (u x v) x w. 
Finding a Least Squares Approximation In Exercises 
67-72, (a) find the least squares approximation 
g(x) = ay + a,x of the function f, and (b) use a graphing 
utility to graph f and g in the same viewing window. 
67. f) =X, 0sx<1 
68. fx) = Jx, 1Sxs4 


69. f(x) =e*, 0<sx<1 
70. fy) = e™, OSxs1 
71. f(x) = cosx, OSxSa7 
72. f(x) = sinx, 0 <x < 7/2 
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Finding a Least Squares Approximation In Exercises 
73-76, (a) find the least squares approximation 
g(x) = ay + a,x + a,x? of the function f, and (b) use a 
graphing utility to graph f and g in the same viewing 
window. 

73. fQ =2, 02x21 74 fx) = Vx, 12x24 
75. f(x) =sinx, —n/25 x < n/2 

76. f(x) = cosx, —n/2 <x < n/2 


Finding a Fourier Approximation In Exercises 77-88, 
find the Fourier approximation with the specified order 
of the function on the interval [0, 27]. 


77. f(x) =n — x, third order 
78. f(x) =x — x, fourth order 
79. f(x) = (x — nm)’, third order 
80. f(x) = (x — 7)?, fourth order 
81. f(x) =e, first order 

82. f(x) = e™*, second order 

83. f(x) = e7*, first order 

84. f(x) = e7™, second order 
85. f(x) = 1+-x, third order 
86. f(x) = 1+ x, fourth order 
87. f(x) = 2 sinxcosx, fourth order 
88. f(x) = sin? x, fourth order 


89. Use the results of Exercises 77 and 78 to find the 
nth-order Fourier approximation of f(x) = 2 — x on 
the interval [0, 27]. 

90. Use the results of Exercises 79 and 80 to find the 
nth-order Fourier approximation of f(x) = (x — r) 
on the interval [0, 27]. 

91. Use the results of Exercises 81 and 82 to find the 
nth-order Fourier approximation of f(x) = e~* on the 
interval [0, 27]. 


92. CAPSTONE 


(a) Explain how to find the cross product of two 
vectors in R°. 


(b) Explain how to find the least squares approximation 
of a function f © C[a, b] with respect to a subspace 


W of C[a, b]. 

(c) Explain how to find the mth-order Fourier 
approximation on the interval [0, 27] of a continuous 
function f with respect to the vector space spanned 
by {1, cos x,. . ., cos mx, sinx,. . ., sin nx}. 


93. Use your school’s library, the Internet, or some other 
reference source to find real-life applications of 
approximations of functions. 
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5 Review Exercises 


See CalcChat.com for worked-out solutions to odd-numbered exercises. Eee 


Finding Lengths, Dot Product, and Distance In 
Exercises 1-8, find (a) |lul|, (b) ||v||, (©) u + v, and (d) d(u, v). 
1. u = (1,4), v= (2,1) 

2. u = (—1,2), v= (2,3) 

3. u = (2,1,1), v= (3,2, =1) 
. u = (—3,2,—2), v= (1,3,5) 
. u = (1,—2,0, 1), v=, 1, -1,0) 
u = (1, —2,2,0), v= (2, —1,0, 2) 
.u=(0,1,-1,1,2), v= (0,1, -2, 1,1) 
8. u = (1,-1,0,1,1), v= (0,1, —2,2, 1) 


NA uM 


Finding Length and a Unit Vector In Exercises 9-12, 
find ||v|| and find a unit vector in the direction of v. 


9. v = (5, 3, —2) 10. v = (-1, —4, 1) 
11. v = (1,1, 2) 12. v = (0,2, — 1) 


13. Consider the vector v = (8, 8, 6). Find u such that 
(a) u has the same direction as v and one-half its length. 


(b) u has the direction opposite that of v and one-fourth 
its length. 


(c) u has the direction opposite that of v and twice its 
length. 


14. For what values of c is ||c(2, 2, — 1)|| = 3? 


Finding the Angle Between Two Vectors In Exercises 
15-20, find the angle 0 between the two vectors. 


15. u = (3,3), v = (—2, 2) 
16. u = (1,—1), v= (0, 1) 


17. u (cos a sin n) v (cos , sin 2m) 
4 4 3 3 
18. u = (cos , sin z), v (cos a sin =) 
6 6 6 6 
19. u = (10, — 5, 15), v = (—2, 1, —3) 
20. u = (0,4,0,-1), v=(1, 1,3, —3) 


Finding Orthogonal Vectors In Exercises 21-24, 
determine all vectors v that are orthogonal to u. 


21. u = (0, —4, 3) 
22. u = (1, —2, 1) 
23. u = (2, —1, 1,2) 
24. u = (0, 1,2, — 1) 


25. Foru = (4, —3, — 1) and v = (5, 3, 1), (a) find the inner 
product represented by (u, v) = u,v, + 2u,v, + 3u3v3, 
and (b) use this inner product to find the distance 
between u and v. 


26. For u = (0, 3, 1) and v = G, 1, —3), (a) find the inner 
product represented by (u, vò = 2u,v, + uv + 2u3V, 
and (b) use this inner product to find the distance 
between u and v. 


27. Verify the triangle inequality and the Cauchy-Schwarz 
Inequality for u and v from Exercise 25. (Use the inner 
product given in Exercise 25.) 

28. Verify the triangle inequality and the Cauchy-Schwarz 
Inequality for u and v from Exercise 26. (Use the inner 
product given in Exercise 26.) 


Calculus In Exercises 29 and 30, (a) find the 
inner product, (b) determine whether the vectors 
are orthogonal, and (c) verify the Cauchy-Schwarz 
Inequality for the vectors. 


29. fx) =x, 80) = (ha) = [seven dx 


30. f(x) = x, g(x) = 4x7, (fg) = Í foel) dx 


Finding an Orthogonal Projection In Exercises 31-36, 
find proj,u. 

31. u = (2,4), v= (1, —-5) 

32. u = (2,3), v = (0,4) 

33. u = (2,5), v = (0,5) 

34. u = (2, —1), v= (7,6) 

35. u = (0, — 1,2), v= (3,2,4) 

36. u = (— 1,3,1), v = (4,0,5) 


Applying the Gram-Schmidt Process In Exercises 
37-40, apply the Gram-Schmidt orthonormalization 
process to transform the given basis for R” into an 
orthonormal basis. Use the Euclidean inner product for R” 
and use the vectors in the order in which they are given. 
37. B = {(, 1), (0, 2)} 

38. B = {(3, 4), (G, 2)} 

39. B= {(0, 3, 4), (1, 0, 0), G, l, 0)} 

40. B = {(0, 0, 2); (0, l; 1), (, Í; 1)} 


41. Let B = {(0, 2, —2), (1,0, —2)} be a basis for a 
subspace of R?, and consider x = (— 1, 4, — 2), a vector 
in the subspace. 

(a) Write x as a linear combination of the vectors in B. 
That is, find the coordinates of x relative to B. 

(b) Apply the Gram-Schmidt orthonormalization 
process to transform B into an orthonormal set B’. 

(c) Write x as a linear combination of the vectors in B’. 
That is, find the coordinates of x relative to B’. 
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42. 


Repeat Exercise 41 for B = {(— 1, 2, 2), (1, 0, 0)} and 
x = (—3, 4, 4). 


Calculus In Exercises 43-46, let f and g be functions 
in the vector space C[a, b] with inner product 


(fg) = i S(x)g(x) dx. 


43. 


44. 


45. 


46. 


47. 


48. 


49. 


50. 


51. 


52. 


53. 


54. 


Show that f(x) = sin x and g(x) = cos x are orthogonal 
in C[0, z]. 


Show that f(x) = V1 — x? and g(x) = 2x/1 — x? are 


orthogonal in C[—1, 1]. 

Let f(x) = x and g(x) = x be vectors in C[O, 1]. 
(a) Find (f, g). 

(b) Find ||g|). 
(c) Find d(f, g). 

(d) Orthonormalize the set B = {f, g}. 

Let f(x) =x +2 and g(x) = 15x — 8 be vectors in 
C[O, 1]. 

(a) Find (f, g). 

(b) Find (— 4f, g). 

(c) Find |||. 

(d) Orthonormalize the set B = { f, g}. 


Find an orthonormal basis for the subspace of Euclidean 
3-space below. 


W = {(x), X3 X3): x, + x, + x, = OF 
Find an orthonormal basis for the solution space of the 
homogeneous system of linear equations. 

x+y-z+ w=0 

2x -y+z+2w=0 

Proof Prove that if u, v, and w are vectors in R”, then 
(u+v)*w=ue-wt+vew. 

Proof Prove that if u and v are vectors in R”, then 

la + vi? + fu — vi = 2al + 2IIvIP. 

Proof Prove that if u and v are vectors in an inner 
product space such that |{ul] < 1 and |[v|| < 1, then 

|(u, v)| < 1. 

Proof Prove that if u and v are vectors in an inner 
product space V, then 

| = Iv] = le = vl 

Proof Let V be an m-dimensional subspace of R” 
such that m < n. Prove that any vector u in R” can be 


uniquely written in the form u = v + w, where v is in 
V and w is orthogonal to every vector in V. 

Let V be the two-dimensional subspace of R4 spanned 
by (0,1,0,1) and (0,2,0,0). Write the vector 
u = (1, 1, 1, 1) in the form u = v + w, where v is in V 
and w is orthogonal to every vector in V. 


56. 


57: 


58. 


59. 


60. 


61. 


62. 


S) 63. 
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. Proof Let{u,,u,,. . ., u,,} be an orthonormal subset 
of R”, and let v be any vector in R”. Prove that 


IP = Sve uy. 

= 
(This inequality is called Bessel’s Inequality.) 
Proof Let {x,,.x,. . .,x,} be a set of real numbers. 
Use the Cauchy-Schwarz Inequality to prove that 
Gy Pag se PS ne ee ee oe ae), 
Proof Let u and v be vectors in an inner product 
space V. Prove that |u + v|| = |u — v|| if and only if u 
and v are orthogonal. 
Writing Let {u,,u,,. . .,u,} be a dependent set of 
vectors in an inner product space V. Describe the result 


of applying the Gram-Schmidt orthonormalization 
process to this set. 


Find the orthogonal complement S+ of the subspace S 
of R? spanned by the two column vectors of the matrix 
1 2 
A= |2 1}. 
0 =] 
Find the projection of the vector v=[1 0 —2]" 
onto the subspace 
0] |0 
S = spany} —1/],} 1 
1] {1 
Find bases for the four fundamental subspaces of the 
matrix 
0 1 0 
A=|0 -3 0). 
1 0 1 


Find the least squares regression line for the set of data 
points 


{(—2, 2), (—1, 1), (0, 1), (1, 3)}. 
Graph the points and the line on the same set of axes. 


Revenue The table shows the revenues y (in billions 
of dollars) for Google, Incorporated from 2006 through 
2013. Find the least squares regression cubic polynomial 
for the data. Then use the model to predict the revenue in 
2018. Let t represent the year, with £ = 6 corresponding 
to 2006. (Source: Google, Incorporated) 


Year 2006 2007 2008 2009 
Revenue, y 10.6 166 21.8 23.7 
Year 2010 2011 2012 2013 
Revenue, y 29.3 37.9 50.2 59.8 
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© «4. Petroleum Production The table shows the North 


American petroleum productions y (in millions of barrels 
per day) from 2006 through 2013. Find the least squares 
regression linear and quadratic polynomials for the data. 
Then use the model to predict the petroleum production in 
2018. Let t represent the year, with £ = 6 corresponding 
to 2006. Which model appears to be more accurate 
for predicting future petroleum productions? Explain. 
(Source: U.S. Energy Information Administration) 


Year 2006 2007 2008 2009 
emt y | 53 154 i 154 
Year 2010 2011 2012 2013 
Po ne a y | 161 16.7 179 193 


Finding the Cross Product In Exercises 65-68, find 
u x v and show that it is orthogonal to both u and v. 


65. u = (1, 1,0), v = (0, 3,0) 

66. u=(1,—-1,1), v= (0,1, 1) 
67.u=j+6k, v=i-2j+k 
68. u = 2i- k, v=i+j-k 


Finding the Volume of a Parallelepiped In Exercises 
69-72, find the volume V of the parallelepiped that 
has u,v, and w as adjacent edges using the formula 
V = |u. (v x w). 


69. u = (1,0,0) 70. u = (1,2, 1) 
v = (0,0, 1) v = (-1, -1,0) 
w = (0, 1,0) w= (3,4, -1) 


x 

7. u = —-2i+j 
v=31-2j+k 
w = 2i — 3j — 2k 


72. u =i + j+ 3k 
v = 3j + 3k 
w = 3i + 3k 


73. Find the area of the parallelogram that has 
u = (1,3,0) and v= (-1, 0,2) 
as adjacent sides. 

74. Proof Prove that 
lu x vil = [fall [vl 


if and only if u and v are orthogonal. 


Finding a Least Squares Approximation In Exercises 
75-78, (a) find the least squares approximation 
g(x) = ay + a,x of the function f, and (b) use a graphing 
utility to graph f and g in the same viewing window. 
75. fx) =x, -1 <sx<1 

76. fix) =x, 0sx<2 

77. f(x) = sin 2x, 0 < x < 1/2 


78. f(x) = sinxcosx, 0Sx <r 


Finding a Least Squares Approximation In Exercises 
79 and 80, (a) find the least squares approximation 
g(x) = ay + a,x + a,x? of the function f, and (b) use a 
graphing utility to graph f and g in the same viewing 
window. 


79. fœ) = vsx, 0S x2 1 E EREET) 
xX 


Finding a Fourier Approximation In Exercises 81 and 
82, find the Fourier approximation with the specified 
order of the function on the interval [— 7, 7]. 


81. f(x) = x, first order 
82. f(x) = x, second order 


True or False? In Exercises 83 and 84, determine 
whether each statement is true or false. If a statement 
is true, give a reason or cite an appropriate statement 
from the text. If a statement is false, provide an example 
that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


83. (a) The cross product of two nonzero vectors in R? 
yields a vector orthogonal to the two vectors that 
produced it. 


(b) The cross product of two nonzero vectors in R? is 
commutative. 


(c) The least squares approximation of a function f is 
the function g (in the subspace W) closest to f in 
terms of the inner product ( f, g). 


84. (a) The vectors u x v and v xu in R? have equal 
lengths but opposite directions. 


(b) If u and v are two nonzero vectors in R°, then u and 
v are parallel if and only if u x v = 0. 


(c) A special type of least squares approximation, the 
Fourier approximation, is spanned by the basis 
S = {1, cos x, cos 2x,. . ., cos nx, sin x, 
sin 2x,. . ., sin nx}. 
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1 The OR-Factorization 


The Gram-Schmidt orthonormalization process leads to an important factorization of 
matrices called the QR-factorization. If A is an m x n matrix of rank n, then A can 
be expressed as the product A = QR of an m x n matrix Q and ann x n matrix R, 
where Q has orthonormal columns and R is upper triangular. 


The columns of A can be considered a basis for a subspace of R”, and the columns 
4 i of Q are the result of applying the Gram-Schmidt orthonormalization process to this 
set of column vectors. 

Recall that Example 7, Section 5.3, used the Gram-Schmidt orthonormalization 
process on the column vectors v,, V, and v, of the matrix 


1 1 0 
A=|1 2 1 
0 0 2 


to produce an orthonormal basis for R?, which is labeled here as q,, q5, q3- 
a: = (2/2, /2/2,0), a2 = (— V2/2, V2/2, 0), a3 = (0,0, 1) 


These vectors form the columns of the matrix Q. 


2 A 
Oe A 2) 0 
0 @) il 


The upper triangular matrix R is 


Vie Gi Vo. 2 ai ao V2 3x 2/2 x 2/2 


= R= 0an 3" G|= © 2 A2 
0 0 v’ 0 0 2 
Verify that A = QR. 
In general, if A is an m x n matrix of rank n with columns v}, V,,. . ., V,,, then 
the QR-factorization of A is 
A =OR 
REMARK “eet Osh lea EO 
The OR-factorization of a 0 Vo°qQ> esa Vn° G5 
matrix forms the basis for Dee ess W SKi G ees il : : : 
many algorithms of linear : : à 
algebra. Algorithms for the v t Va * Qn 
computation of eigenvalues where the columns q,,q),. . -> Q, Of the m x n matrix Q are the orthonormal 
(see Chapter 7) are based vectors that result from the Gram-Schmidt orthonormalization process. 


on this factorization, as are 


algorithms for computing the 1. Find the QR-factorization of each matrix. 


least squares regression line 1 0 1 =i 
for a set of data points. It should 1 1 0 0 i 3 0 
also be mentioned that, in (a) A=|0 1 (b) A= (c) A= 

practice, techniques other 1 1 1 1 2 0 
than the Gram-Schmidt 1 2 1 0 0 


orthonormalization process 
are used to compute the 
OR-factorization of a matrix. 


2. Let A = QR be the QR-factorization of the m x n matrix A of rank n. Show how 
the least squares problem can be solved using the QR-factorization. 


3. Use the result of part 2 to solve the least squares problem Ax = b when A is the 
matrix from part 1(a)andb =[—1 1 -—1F. 


Maridav/Shutterstock.com 
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2 Orthogonal Matrices and Change of Basis 


Let B = {v}, V». . ., V,} be an ordered basis for the vector space V. Recall that 
the coordinate matrix of a vector x = cv, + c,Vv, t- +c Y, in V is the 
column vector 


If B’ is another basis for V, then the transition matrix P from B’ to B changes a 
coordinate matrix relative to B’ into a coordinate matrix relative to B, 


P[x], = [E]; 


The question you will explore now is whether there are transition matrices P 
that preserve the length of the coordinate matrix—that is, given P[x],, = [x],, does 


lbi = ll? 


For example, consider the transition matrix from Example 5 in Section 4.7, 


Ar 


relative to the bases for R?, 

B= {(-3, 2), (4,—2)} and B’ = {(—1, 2), 2, —2)} 
Ifx = (—1, 2), then[x],, = [1 ç 0f and[x], = P[x],, = [3 2]. (Verify this.) So, 
using the Euclidean norm for R?, 

lod = 1 # 13 = |i]. 


You will see in this project that if the transition matrix P is orthogonal, then the 
norm of the coordinate vector will remain unchanged. You may recall working with 
orthogonal matrices in Section 3.3 (Exercises 73—82) and Section 5.3 (Exercise 65). 


Definition of Orthogonal Matrix 


The square matrix P is orthogonal when it is invertible and P~! = PY. 


1. Show that the matrix P defined previously is not orthogonal. 
2. Show that for any real number 0, the matrix 
ee 6 Sin | 
sin 0 cos 0 
is orthogonal. 


3. Show that a matrix is orthogonal if and only if its columns are pairwise 
orthogonal. 


4. Prove that the inverse of an orthogonal matrix is orthogonal. 


5. Is the sum of orthogonal matrices orthogonal? Is the product of orthogonal 
matrices orthogonal? Illustrate your answers with appropriate examples. 


6. Prove that if P is an n x n orthogonal matrix, then ||Px|| = ||x|| for all vectors x 
in R’. 


7. Verify the result of part 6 using the bases B = {(1, 0), (0, 1)} and 


Aee 
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>< 


Figure for 10(b) 


Cumulative Test for Chapters 4 and 5 295 


[m] pee: [m] 
ou 


See CalcChat.com for worked-out solutions 
to odd-numbered exercises. 


Take this test to review the material in Chapters 4 and 5. After you are finished, 
check your work against the answers in the back of the book. 


1. 


10. 


11. 


Consider the vectors v = (1, —2) and w = (2, — 5). Find and sketch each vector. 
(a) V+w (b) 3v (c) 2v — 4w 


. Write w = (7, 2, 4) as a linear combination of the vectors v,, v, and v; (if possible). 


vi = (2, 1; 0), V2 = G, =I; 0), V3 = (0, 0, 6) 


. Write the third column of the matrix as a linear combination of the first two 


columns (if possible). 


1 0 -2 
4 2 =2 
T 5 1 


. Use a software program or a graphing utility to write v as a linear combination of 


U,, U,, Us, Uy, Us, and uç. Then verify your solution. 
v = (10, 30, — 13, 14, —7, 27) 
u; T (1, 2, a 4, ga 1, 2) 


( 

u = (0, 2, = 1,2, —1, =1) 
(1, 0, 3, —4, 1, 2) 
( 


u, = (3, 2, 1, —2, 3, 0) 


. Prove that the set of all singular 3 x 3 matrices is not a vector space. 


. Determine whether the set is a subspace of R*. 


{œx + y, y, y): mY E R} 


. Determine whether the set is a subspace of R°. 


{lx xy, y): x, y = R} 


. Determine whether the columns of matrix A span R*. 


1 2- =] 0 


1 3 0 2 
A= ọ 1-1 
1 0 0 1 


. (a) Explain what it means to say that a set of vectors is linearly independent. 


(b) Determine whether the set S is linearly dependent or independent. 
S = {(1, 0, 1, 0), (0, 3, 0, 1), (1, 1, 2, 2), (3, 4, 1, —2)} 
(a) Define a basis for a vector space. 


(b) Determine whether the set {v,, v,} shown in the figure at the left is a basis 
for R?. 


(c) Determine whether the set below is a basis for R°. 
{(1, 2; 1), (0, 1 2), (2, 1, —3)} 
Find a basis for the solution space of Ax = 0 when 
1 1 0 0 


-2 -2 0 0 
a= o © 1 ıf 
1 1 0 0 
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12. 


13. 


14. 


15. 


16. 


17. 


18. 


19. 


20. 


21. 


22. 


23. 


24. 


Find the coordinates [v], of the vector v = (1, 2, — 3) relative to the basis 

B = {(0, 1, 1), (1, 1, 1), (1,0, D}. 

Find the transition matrix from the basis B = {(2, 1, 0), (1, 0, 0), (0, 1, 1)} to the basis 
B' = {(1, 1, 2), (1, 1, 1), (0, 1, 2)}. 

Let u = (1, 2, 0) and v = (1, — 3, 2). 

(a) Find |full. 
(b) Find the distance between u and v. 

(c) Findus v. 

(d) Find the angle 0 between u and v. 

Find the inner product of f(x) = x? and g(x) = x + 2 from C[0, 1] using 


(fg) = | Oa 


Apply the Gram-Schmidt orthonormalization process to transform the set of 
vectors into an orthonormal basis for R°. 
{(2, 0, 0), (1, 1, 1), (0, 1, 2)} 
Let u = (1, 2) and v = (—3, 2). Find proj,u, and graph u, v, and proj,u on the 
same set of coordinate axes. 
Find the four fundamental subspaces of the matrix 
0 1 1 0 
A= |-1 0 0 1}. 
1 1 1 1 


Find the orthogonal complement S+ of the set 

1} j=] 
S =spany/0],| 1 

1 0 
Consider a set of n linearly independent vectors S = Tii; K erg x, }: Prove that 
if a vector y is not in span(S), then the set S, = {x,,X),. . .,X,, y} is linearly 
independent. 


Find the least squares regression line for the points {(1, 1), (2, 0), (5, —5)}. Graph 
the points and the line. 


The two matrices A and B are row-equivalent. 
2 —4 0 1 T n I =2 0 0 3 2 
NE l =2 =] 1 9 12 B= 0 0 1 0: =5 3 
=1 2 1 3 -5 16 0 0 0 1 1 
4 -8 L =] 6 -2 0 0 0 0 0 0 


(a) Find the rank of A. 

(b) Find a basis for the row space of A. 

(c) Find a basis for the column space of A. 

(d) Find a basis for the nullspace of A. 

(e) Is the last column of A in the span of the first three columns? 
(f) Are the first three columns of A linearly independent? 

(g) Is the last column of A in the span of columns 1, 3, and 4? 
(h) Are columns 1, 3, and 4 linearly dependent? 


Let S, and S, be two-dimensional subspaces of R°. Is it possible that 
Si O S$, = {(0, 0, 0)}? Explain. 

Let V be a vector space of dimension n. Prove that any set of less than n vectors 
cannot span V. 
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6.1 


REMARK 


For a vector 
V = (Vy, Vor» + Vp) 


in R”, it would be more 
correct to use double 
parentheses to denote T(v) 


as T(v) = T((Vy, Vo,» <, Vp) 


For convenience, however, 
drop one set of parentheses 
to produce 


T(v) = T(V, Vor + <, Vp) 


Find the image and preimage of a function. 


Show that a function is a linear transformation, and find a linear 
transformation. 


IMAGES AND PREIMAGES OF FUNCTIONS 


In this chapter, you will learn about functions that map a vector space V into a vector 
space W. This type of function is denoted by 


T: VOW. 


The standard function terminology is used for such functions. For instance, V is 
the domain of 7, and W is the codomain of 7. If v is in V and w is in W such that 
T(v) = w, then w is the image of v under T. The set of all images of vectors in V is 
the range of T, and the set of all v in V such that 7(v) = w is the preimage of w. (See 
below.) 


V: Domain 
Range 


T:V—W W: Codomain 


EXAMPLE 1 A Function from R? into R? 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


For any vector v = (v,, v5) in R?, define T: R? — R? by 
Tes v2) = (vi = va vi + 2v,). 
a. Find the image of v = (— 1, 2). 
b. Find the image of v = (0, 0). 
c. Find the preimage of w = (— 1, 11). 
SOLUTION 
a. For v = (—1, 2), you have 
T(-1, 2) = (-1 — 2, —1 + 2(2)) = (-3, 3). 
b. If v = (0, 0), then 
T(0, 0) = (0 — 0,0 + 2(0)) = (0, 0). 
c. If T(v) = (vi — vo, vı + 2v,) = (—1, 11), then 
v= w& = l 
v +2% = 1l. 


This system of equations has the unique solution v, = 3 and v, = 4. So, the 
preimage of (— 1, 11) is the set in R? consisting of the single vector (3, 4). | 
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LINEAR TRANSFORMATIONS 


This chapter centers on functions that map one vector space into another and preserve 
the operations of vector addition and scalar multiplication. Such functions are called 
linear transformations. 


Definition of a Linear Transformation 


Let V and W be vector spaces. The function 


T: V>W 
is a linear transformation of V into W when the two properties below are true for 
all u and v in V and for any scalar c. 


1. Tíu + v) = Tlu) + T(v) 
2. T(cu) = cT(u) 


A linear transformation is operation preserving because the same result occurs 
whether you perform the operations of addition and scalar multiplication before or after 
applying the linear transformation. Although the same symbols denote the vector 
operations in both V and W, you should note that the operations may be different, 
as shown in the diagram below. 


Addition | | Addition 
in V in W 


T(u + v) = Tíu) + T(v) T(cu) = cT(u) 


Scalar Scalar 


multiplication | | multiplication 
in V in W 


EXAMPLE 2 Verifying a Linear Transformation 


from R? into R? 


Show that the function in Example 1 is a linear transformation from R? into R?. 


T(v;, v2) = (v, = V9, V + 2v2) 
SOLUTION 


To show that the function T is a linear transformation, you must show that it preserves 
vector addition and scalar multiplication. To do this, let v = (v,, v,) and u = (u,, u,) be 
vectors in R? and let c be any real number. Then, using the properties of vector addition 
and scalar multiplication, you have the two statements below. 


1. u + v= (u, u) + (vi, V2) = (uy + vi, u, + V5), so you have 


T(u + v) = T(u, + vi uy + v3) 


REMARK = ((u, + v,) — (u + v), (u + vi) + 2(u + v,)) 
A linear transformation = ((u, = u) + (v; = v3), (u, + 2u) + (v; + 2v,)) 
T: V> V from a vector space = (u; — u, u, + 2u) + (vi — va v; + 2v3) 
into itself (as in Example 2) is = T(u) + T(v). 


called a linear operator. 


2. cu = c(u,, u) = (cu,, cu), so you have 


T(cu) = T(cuy,, cu) 


= (cu, — cus, cu, + 2cu,) 
1 2 CU, 2 


Clu, — Uy, uy, + 2u,) 
cT(u). 


So, T is a linear transformation. | 
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REMARK 


The function in Example 3(c) 
suggests two uses of the 

term linear. The function 

f(x) = x + 1 is a linear function 
because its graph is a line. It 

is not a linear transformation 
from the vector space R into R, 
however, because it does not 
preserve vector addition 

or scalar multiplication. 


REMARK 


One advantage of Theorem 6.1 
is that it provides a quick way 
to identify functions that are 
not linear transformations. 
That is, all four conditions of 
the theorem must be true of 
a linear transformation, so it 
follows that if any one of the 
properties is not satisfied for 
a function T, then the function 
is not a linear transformation. 
For example, the function 


T(x X) = (x, + 1, X) 


is not a linear transformation 
from R? into R? because 
T(0, 0) # (0, 0). 


Chapter 6 Linear Transformations 


Many common functions are not linear transformations, as demonstrated in 
Example 3. 


EXAMPLE 3 
a. f(x) = sin x is not a linear transformation from R into R because, in general, 


sin(x, + x,) # sinx, + sin x,. For example, 


sin[(7/2) + (2/3)] # sin(z/2) + sin(z/3). 


Some Functions That Are 
Not Linear Transformations 


b. f(x) = x? is not a linear transformation from R into R because, in general, 
(ty + x)? # x? + x2. For example, (1 + 2) + 1? + 2. 


c. f(x) = x + 1 is not a linear transformation from R into R because 


fata) Sx ee 1 


whereas 
f(x) +f) = k t1) +a lS ta +2. 
So f(x, + x) # f) + fo). | 


Two simple linear transformations are the zero transformation and the identity 
transformation, which are defined below. 


1. T(v) = 0, for all v 
2. T(v) = v, for all v 


Zero transformation (T: V—> W) 
Identity transformation (T: V— V) 


You are asked to prove that these are linear transformations in Exercise 77. 

Note that the linear transformation in Example 1 has the property that the zero 
vector maps to itself. That is, 7(0) = 0, as shown in Example 1(b). This property is 
true for all linear transformations, as stated in the first property of the theorem below. 


THEOREM 6.1 


Let T be a linear transformation from V into W, where u and v are in V. Then the 
properties listed below are true. 


Properties of Linear Transformations 


1. 7(0) = 0 

2. T(—v) = —T(v) 

3. T(u — v) = T(u) — T(v) 

4. Ifv = civ; + ov, +--+ + +¢,N,, then 

T(v) = T(cyv, + CVa +++ + + cY) = cT) + T(v,) ++ + + +.¢,TCy,). 
PROOF 
To prove the first property, note that Ov = 0. Then it follows that 
T(0) = T(Ov) = OT(v) = 0. 


The second property follows from —v = (— 1)v, which implies that 
T(—v) = T[(—-1)v] = (-1)T(y) = -T(v). 

The third property follows from u — v = u + (—v), which implies that 
T(u — v) = T[u + (—1)v] = Tíu) + (—1)7(v) = Tíu) — T(v). 


The proof of the fourth property is left to you. m 


Property 4 of Theorem 6.1 suggests that a linear transformation T: V— W is 
determined completely by its action on a basis for V. In other words, if {v,, V>,. . -, Va} 
is a basis for the vector space V and if T(v,), T(v>),. . ., T(v,,) are given, then T(v) can 
be determined for any v in V. Example 4 demonstrates the use of this property. 
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EXAMPLE 4 Linear Transformations and Bases 


Let T: R? > R? be a linear transformation such that 
T(1, 0, 0) = (2, — 1, 4) 
T(0, 1,0) = (1,5, — 2) 
T(0, 0, 1) = (0,3, 1). 

Find T(2, 3, —2). 


SOLUTION 
(2,3, —2) = 2(1, 0, 0) + 3(0, 1, 0) — 2(0, 0, 1), so use Property 4 of Theorem 6.1 to 
write 


T(2, 3, —2) = 27(1, 0, 0) + 37(0, 1,0) — 27(0, 0, 1) 
= 2(2, —1, 4) + 3(1, 5, —2) = 2(0, 3, 1) 


= (7,7,0). a 


In the next example, a matrix defines a linear transformation from R? into R°. 
The vector v = (vj, v>) is in the matrix form 


| 


so it can be multiplied on the left by a matrix of size 3 x 2. 


EXAMPLE 5 A Linear Transformation Defined by a Matrix 


Define the function T: R? — R? as 


3 0 
Tv) =Av=| 2 i] 
-1 =o" 


a. Find T(v) when v = (2, — 1). 


b. Show that T is a linear transformation from R? into R?. 


SOLUTION 
a. v = (2, — 1), so you have 
3 0 > 6 
T(v) =Av=| 2 1 EG 3 
={ =2 (0) 


Vector Vector 
in R? in R? 


which means that T(2, — 1) = (6, 3, 0). 


b. Begin by observing that T maps a vector in R? to a vector in R’. To show that T 
is a linear transformation, use properties given in Theorem 2.3. For any vectors u 
and v in R?, the distributive property of matrix multiplication over addition produces 


Tíu + v) = A(u + v) = Au + Av = T(u) + T(V). 


Similarly, for any vector u in R? and any scalar c, the commutative property of scalar 
multiplication with matrix multiplication produces 


T(cu) = A(cu) = c(Au) = cT(u). a 
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Example 5 illustrates an important result regarding the representation of linear 
transformations from R” into R”. This result is presented in two stages. Theorem 6.2 
below states that every m x n matrix represents a linear transformation from R” into 
R”. Then, in Section 6.3, you will see the converse—that every linear transformation 
from R” into R” can be represented by an m x n matrix. 

Note that the solution of Example 5(b) makes no reference specifically to the 
matrix A that defines T. So, this solution serves as a general proof that the function 
defined by any m x n matrix is a linear transformation from R” into R”. 


REMARK 
The m x n zero matrix THEOREM 6.2 Linear Transformation Given by a Matrix 
corresponds to the zero . . : 
transformation fram Rinto Let A be anm x n matrix. The function T defined by 
R™, and the n x n identity T(v) = Av 
matrix /, corresponds to the 
identity transformation from is a linear transformation from R” into R”. In order to conform to matrix 
R” into R”. multiplication with an m x n matrix, n x 1 matrices represent the vectors in R” 


and m x 1 matrices represent the vectors in R”. 


Be sure you see that an m x n matrix A defines a linear transformation from R” 


into R”: 
Ai Ai -> Ayn || Vy Ay Vy E AWV Fe + + + Ann 
Age Gy, an ©»  Agy | | V2] _ | AVi F AWV Fo E Aan, 
amı Am2 se Amn AmiYı + Am2V2 TA <p AmnYn 


Va 
Vector Vector 
in R” in Rk” 
EXAMPLE 6 Linear Transformations Given by Matrices 


Consider the linear transformation T: R”—>R” defined by T(v) = Av. Find the 
dimensions of R” and R” for the linear transformation represented by each matrix. 


0 1 —1 2 =3 
a A=]|2 3 b. A=]|-5 0 
4 2 1 0 =2 
1 0: =l 2 
.4A= 
E |; 1 | 
SOLUTION 
a. The size of this matrix is 3 x 3, so it defines a linear transformation from R? into R?. 
(0) 1 =1 v Uy 
Av =|2 3 Ol} vy] = |m 
4 2 1] v3 Uy 


Vector | | Vector 
in R? in R? 


b. The size of this matrix is 3 x 2, so it defines a linear transformation from R? into R?. 


c. The size of this matrix is 2 x 4, so it defines a linear transformation from R* into R?. 


Copyright 2017 Cengage Learning. All Rights Reserved. May not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eBook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage Learning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


6.1 Introduction to Linear Transformations 303 


The next example discusses a common type of linear transformation from R? into R?. 


“EXAMPLE 7 Rotation in R2 


Show that the linear transformation T: R? > R? represented by the matrix 


i ie 0 —sin | 


sin  cos@ 


has the property that it rotates every vector in R? counterclockwise about the origin 
through the angle 0. 


SOLUTION 


From Theorem 6.2, you know that T is a linear transformation. To show that it rotates 
every vector in R? counterclockwise through the angle 0, let v = (x, y) be a vector 
in R?. Using polar coordinates, you can write v as 


v = (x, y) 
= (r cos a, r sin a) 


where r is the length of v and « is the angle from the positive x-axis counterclockwise 
to the vector v. Now, applying the linear transformation T to v produces 


T(v) = Av 
cos@ —sin@||x 
7 | sin@ cos J H 
cos —sin 0 || r cos « 
~ hee cos | ee 


B þor — kad 


r sin 0 cos a+ r cos 0 sina 


= | cos(@ + | 


rsin(@ + a) 


Verify that the vector T(v) has the same length as v. Furthermore, the angle from the 
positive x-axis to T(v) is 


O+a 


so T(v) is the vector that results from rotating the vector v counterclockwise through 
the angle 0, as shown below. 


Rotation in R? 


The linear transformation in Example 7 is a rotation in R?. Rotations in R? 
preserve both vector length and the angle between two vectors. That is, ||7(u)]] = jul], 
\|7(v)|| = ||v||, and the angle between 7(u) and T(v) is equal to the angle between u 
and v. 
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EXAM PLE 8 A Projection in R? 


The linear transformation T: R? — R? represented by 


1 0 0 
A= /0 1 0 
0 0 0 


is a projection in R°. If v = (x, y, z) is a vector in R3, then 7(v) = (x, y, 0). In other 
words, T maps every vector in R? to its orthogonal projection in the xy-plane, as shown 
below. 


(x, y, z) 


--}a----«---9 


* 


x y 


T(x, y, z) = (x, y, 0) 


— 
Projection onto xy-plane m 


So far, only linear transformations from R” into R” or from R” into R” have 
been discussed. The remainder of this section considers some linear transformations 
involving vector spaces other than R”. 


EXAMPLE 9 A Linear Transformation from M,, n into M, m 


Let T: M 


m,n 


T(A) = A’. 


— M,,,, be the function that maps an m x n matrix A to its transpose. That is, 


Show that T is a linear transformation. 


SOLUTION 


Let A and B be m x n matrices and let c be a scalar. From Theorem 2.6 you have 
T(A + B) = (A+ B) = AT + B? = T(A) + T(B) 


and 


T(cA) = (cA)? = c(AT) = cT(A). 


So, T is a linear transformation from M,,,,, into M, m- | 


LINEAR Many multivariate statistical methods can use linear 
ALG EBRA transformations. For instance, In a multiple regression 
analysis, there are two or more independent variables and 
APPLIED a single dependent variable. A linear transformation is useful 
for finding weights to be assigned to the independent 
variables to predict the value of the dependent variable. 
Also, in a canonical correlation analysis, there are two or 
more independent variables and two or more dependent 
variables. Linear transformations can help find a linear 
combination of the independent variables to predict the 
value of a linear combination of the dependent variables. 


wrangler/Shutterstock.com 
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De RSet The Differential Operator (Calculus) 


Let C'[a, b] be the set of all functions whose derivatives are continuous on [a, b]. Show 
that the differential operator D, defines a linear transformation from C’[a, b] into C[a, b]. 


SOLUTION 


Using operator notation, you can write 


DAF) = ŽIA 


where f is in C'[a, b]. To show that D, is a linear transformation, you must use calculus. 
Specifically, the derivative of the sum of two differentiable functions is equal to the sum 
of their derivatives, so you have 


DF + 8) = SF + 8] = ŽIA + SIs] = DUA) + De) 


where g is also in C’[a, b]. Similarly, the derivative of a scalar multiple cf of a 
differentiable function is equal to the scalar multiple of the derivative, so you have 


DAP = “ter = (EU) = eon. 


The sum of two continuous functions is continuous, and the scalar multiple of a 
continuous function is continuous, so D, is a linear transformation from C ‘Ta, b] into 
Cla, b]. 


The linear transformation D, in Example 10 is called the differential operator. 
For polynomials, the differential operator is a linear transformation from P, into P,_ , 
because the derivative of a polynomial function of degree n = 1 is a polynomial 
function of degree n — 1. That is, 


Dia, + ax toe tag) = apts = ++ na" 


The next example describes a linear transformation from the vector space of 
polynomial functions P into the vector space of real numbers R. 


we The Definite Integral as a Linear 
EXAMPLE 11 Transformation (Calculus) 


Consider T: P — R defined by 


where p is a polynomial function. Show that T is a linear transformation from P, 
the vector space of polynomial functions, into R, the vector space of real numbers. 


SOLUTION 


Using properties of definite integrals, you can write 
b 


T(p + q4)= f Lp(x) + q(x)] dx = f p(x) dx + [ q(x) dx = T(p) + T(q) 


a 


where q is a polynomial function, and 
b 


T(cp) = f [ep(x)] dx = c f p(x) dx = cT(p) 


a 


where c is a scalar. So, T is a linear transformation. | 
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6.1 Exercises 


Finding an Image and a Preimage_ In Exercises 1-8, 
use the function to find (a) the image of v and (b) the 
preimage of w. 


1. T(v,, va) = (Vv, + v» vi — Vo), 
v = (3, —4), w = (3, 19) 
2. T(V,, v2) = (vi 2v3 — V4, V2), 
v = (0,4), w = (2, 4, 3) 
3. Thvj, Va v3) = (2v; + Vy 2v, — 
= (-4,5, 1), w = (4, 1, -1) 


4. T(v,, Va V3) = (vo — Vp Vi + Vo, 2v,), 


Bio Vi = v3), 


= (2, 3,0), w = (-11, —1, 10) 
5. T(v,, Vos V3) = (4v, = vv + 5v), 
v = (2, —3, —1), w = (3,9) 


6. T(vi, Vo, V3) = (2v; + va vi — Vo), 
v= (2,1,4), w= (1,2) 


Tz Y2 Yı Fray w = v), 


v= (1,1), w = (75/2, 
J3 1 
“ay Ya 7”? Vi T Vos Vo Jo 


v= (2,4), w= (V3, 2. 0) 


Linear Transformations In Exercises 9-22, determine 
whether the function is a linear transformation. 


9. T: R? > R?, T(x, y) = (x, 1) 
10. T: R? > R?, T(x, y) = (x, y?) 
11. T: BÈ >R, T(x, y, z) = (x + y,x — y, z) 
12. T: È >R?, m g=@+1Lyt+i12+1) 
13. T: R> R3, TI Ta xy, Vy) 
14. T: R? > R?, - “i (x?, xy, y?) 
15. T: M,, >R, T(A) = “a 
16. T: M,,>R, T(A) =a + b + c + d, where 
a b 
A= |? A 


17. T: M 3 >R, T(A) = a — b — c — d, where 
a b 
A= : 
f A 


18. T: M,,—R, T(A) = b’, where A = I“ A 


—2, — 16) 


d 
0 0 4 
19. T: M,; >M; T(A)=]0 1 O|A 
1 0 0 


See CalcChat.com for worked-out solutions to odd-numbered exercises. 


JF: 
3 0 
20. T:M;; >M; T(A)=|0 2 oja 
0 0 
21. T: P, SP, T(dy + ax + ax?) = 
(ag + a; + a) + (a, + ae + ax? 
22. T: P, >P, T(dy + ax + axx?) = a, + 2ayx 
23. Let T be a linear transformation from R? into R? 


such that 7(1, 0) = (1, 1) and 7(0, 1) = (—1, 1). Find 
T(1, 4) and 7(—2, 1). 

24. Let T be a linear transformation from R? into R? 
such that T(1, 2) = (1, 0) and 7(—1, 1) = (0, 1). Find 
T(2, 0) and 7(0, 3). 


Linear Transformation and Bases In Exercises 
25-28, let T: R? — R? be a linear transformation such 
that 7(1, 0,0) = (2,4,-1), 7T(0, 1,0) = (1,3, —2), and 


T(0, 0, 1) = (0, —2, 2). Find the specified image. 
25. T(1, —3, 0) 26. 7T(2, —1, 0) 
27. T2, —4, 1) 28. T(—2, 4, —1) 


Linear Transformation and Bases [In Exercises 29-32, 
let T: R?— R? be a linear transformation such that 
T(1, 1,1) = (2,0, —1), T(0,—1,2) = (—3,2,—1), and 
T(1, 0, 1) = (1, 1, 0). Find the specified image. 

29. T(4, 2, 0) 30. 7(0, 2, —1) 

31. T(2, —1, 1) 32. T(—2, 1, 0) 

Linear Transformation Given by a Matrix In Exercises 


33-38, define the linear transformation T: R” => R” by 
T(v) = Av. Find the dimensions of R” and R”. 


i. 2 
aas a o 34. A=|-2 4 
=f 2 
1 0 o0 
0-1 0 0 
FAS 0 1 0 
0 0 0 2 
=i 2 tf & 4 
36.4 =| 4 0 2-1 ol 
Oo 1 -2 1 
37.A=|-1 4 5 0 
0 1 3 1 
0 2 0 2 0 
38. A=|1 0 1 0 1 
i 2. 2 2 J 
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39. For the linear transformation from Exercise 33, find 
(a) T(1, 1), (b) the preimage of (1,1), and (c) the 
preimage of (0, 0). 

40. Writing For the linear transformation from Exercise 
34, find (a) T(2, 4) and (b) the preimage of (— 1, 2, 2). 
(c) Then explain why the vector (1, 1, 1) has no preimage 
under this transformation. 


41. For the linear transformation from Exercise 35, find 
(a) T(2, 1, 2, 1) and (b) the preimage of (—1, —1, —1, —1). 

42. For the linear transformation from Exercise 36, find 
(a) T(1, 0, — 1, 3, 0) and (b) the preimage of (— 1, 8). 

43. For the linear transformation from Exercise 37, find 
(a) T(1, 0, 2, 3) and (b) the preimage of (0, 0, 0). 

44. For the linear transformation from Exercise 38, find 
(a) T(0, 1,0, 1,0) (b) the preimage of (0, 0,0), and 
(c) the preimage of (1, — 1, 2). 

45. Let T be a linear transformation from R? into R? such that 
T(x, y) = («cos 0 — y sin 0, xsin@ + ycos 0). Find 
(a) 7(4, 4) for 0 = 45°, (b) 7(4, 4) for 0 = 30°, and 
(c) T(5, 0) for 0 = 120°. 

46. For the linear transformation from Exercise 45, let 
0 = 45° and find the preimage of v = (1, 1). 

47. Find the inverse of the matrix A in Example 7. What linear 
transformation from R? into R? does A~! represent? 


48. For the linear transformation T: R? > R? given by 
a —b 
A= 
p | 
find a and b such that 7(12, 5) = (13, 0). 


Projection in R? In Exercises 49 and 50, let the matrix 
A represent the linear transformation T: R?— R°. 
Describe the orthogonal projection to which T maps 
every vector in R°. 


1 0 0 0 0 
49. A=|0 0 0 50. A =| 0 1 0 
0 0 1 0 1 


Linear Transformation Given by a Matrix In Exercises 
51-54, determine whether the function involving the 
n x n matrix A is a linear transformation. 


51. T: Mpa S Mi» T(A) = A`! 

52. T: M,,,—>M,,,,, T(A) = AX — XA, where X is a fixed 
n x m matrix 

53. T: M,,,,>M,,,,. T(A) = AB, where B is a fixed n x m 
matrix 


54. T:M,„ >R, T(A) = ay, * dy) * > + + * Apn Where A = [a;] 
55. Let T be a linear transformation from P, into P, such 
that T(1) = x, T(x) = 1 + x, and TX?) = 1 +x + 2x2. 


Find T(2 — 6x + x?). 
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56. Let T be a linear transformation from M,, into M33 


A P-P a? e A 
Dl tk ie hi l 
smar a) 


Calculus In Exercises 57-60, let D, be the linear 
transformation from C'|a,b] into C[a,b] from 
Example 10. Determine whether each statement is true 
or false. Explain. 


57. D(e* + 2x) = De®) + 2D,(x) 
58. D(x? — In x) = D(x?) — D,(In x) 
59. D,(sin 3x) = 3D,(sin x) 


0 
0 
0 
0 


| 
| 


x 1 
60. D,(cos z) = zP(cos x) 


Calculus In Exercises 61-64, for the linear 
transformation from Example 10, find the preimage of 
each function. 


61. D(f) = 4x + 3 62. D(f) = e 


63. D(f) = sinx 64. D(f) =~ 


65. Calculus Let T be a linear transformation from P into 
R such that 


T(p) = Í p(x) dx. 


Find (a) T(—2 + 3x?), (b) T(x? — x5), and (c) T(—6 + 4x). 

66. Calculus Let T be the linear transformation from 
P, into R using the integral in Exercise 65. Find the 
preimage of 1. That is, find the polynomial function(s) 
of degree 2 or less such that T(p) = 1. 


True or False? In Exercises 67 and 68, determine 
whether each statement is true or false. If a statement 
is true, give a reason or cite an appropriate statement 
from the text. If a statement is false, provide an example 
that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


67. (a) The function f(x) = cos x is a linear transformation 
from R into R. 


(b) For polynomials, the differential operator D, is a 

linear transformation from P, into P,,_ |. 

68. (a) The function g(x) = x° is a linear transformation 
from R into R. 


(b) Any linear function of the form f(x) = ax + bisa 
linear transformation from R into R. 
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69. Writing Let T: R?— R? such that T(1, 0) = (1, 0) and 
T(0, 1) = (0, 0). 
(a) Determine T(x, y) for (x, y) in R?. 
(b) Give a geometric description of T. 

70. Writing Let T: R? — R? such that T(1, 0) = (0, 1) and 
T(0, 1) = (1, 0). 
(a) Determine T(x, y) for (x, y) in R?. 
(b) Give a geometric description of T. 

71. Proof Let T be the function that maps R? into R° such 
that T(u) = proj,u, where v = (1, 1). 
(a) Find T(x, y). (b) Find 7(5, 0). 
(c) Prove that T is a linear transformation from R? 

into R?. 

72. Writing Find 7(3, 4) and 7(7(3, 4)) from Exercise 71 

and give geometric descriptions of the results. 


73. Show that T from Exercise 71 is represented by the 
matrix 


L 
2 
if 
2 


74. CAPSTONE Explain how to determine 


whether a function T:V—W is a linear 


transformation. 


75. Proof Use the concept of a fixed point of a linear 
transformation T: VV. A vector u is a fixed point 
when 7(u) = u. 

(a) Prove that 0 is a fixed point of any linear 
transformation T: V> V. 

(b) Prove that the set of fixed points of a linear 
transformation T: V— V is a subspace of V. 

(c) Determine all fixed points ofthe linear transformation 
T: R? — R? represented by T(x, y) = (x, 2y). 

(d) Determine all fixed points of the linear transformation 
T: R? > R? represented by T(x, y) = (y, x). 

76. A translation in R? is a function of the form 
T(x, y) = (x — h, y — k), where at least one of the 
constants h and k is nonzero. 

(a) Show that a translation in R? is not a linear 
transformation. 

(b) For the translation T(x, y) = (x — 2,y + 1), 
determine the images of (0, 0), (2, — 1), and (5, 4). 

(c) Show that a translation in R? has no fixed points. 

77. Proof Prove that (a) the zero transformation and (b) 
the identity transformation are linear transformations. 

78. Let S = {v,, v>, V3} be a set of linearly independent 
vectors in R?. Find a linear transformation T from R? 
into R? such that the set {7(v,), T(v), T(v3)} is linearly 
dependent. 


79. 


80. 


81. 


82. 


83. 


84. 


Proof Let S = {v}, Vn. . ., V„} be a set of linearly 
dependent vectors in V, and let T be a linear 
transformation from V into V. Prove that the set 


{T(v,), T(v), ee | T(v,,)} 
is linearly dependent. 


Proof Let V be an inner product space. For a fixed 
vector Vy in V, define T: VR by T(v) = (v, Vo). Prove 
that T is a linear transformation. 


Proof Define T: M,,,—R by 


T(A) = aii T Ay apes ot ok Ann 
(the trace of A). Prove that T is a linear transformation. 


Let V be an inner product space with a subspace W 
having B = {w,, W>, . . ., W„} as an orthonormal basis. 
Show that the function T: V — W represented by 


T(v) = (v, Wi) Wi + (V, W5)w, +- - + (v, WW, 
is a linear transformation. T is called the orthogonal 


projection of V onto W. 


Guided Proof Let {v}, V2}, . . ., V„} be a basis for 
a vector space V. Prove that if a linear transformation 
T: VV satisfies T(v;) = 0 fori = 1,2,. . ., n, then 
T is the zero transformation. 

Getting Started: To prove that T is the zero 
transformation, you need to show that 7(v) = 0 for 
every vector v in V. 


(i) Let v be an arbitrary vector in V such that 


PEP CGY 


V= CV, + CoV, t: Vi: 
(ii) Use the definition and properties of linear 
transformations to rewrite T(v) as a linear 


combination of T(v,). 


(iii) Use the fact that 7(v,) = 0 to conclude that 
T(v) = 0, making T the zero transformation. 


Guided Proof Prove that 7: V—W is a linear 
transformation if and only if 


T(au + bv) = aT(u) + bT(v) 
for all vectors u and v and all scalars a and b. 


Getting Started: This is an “if and only if” statement, 

so you need to prove the statement in both directions. 

To prove that T is a linear transformation, you need 

to show that the function satisfies the definition of 

a linear transformation. In the other direction, let T 

be a linear transformation. Use the definition and 

properties of a linear transformation to prove that 

T(au + bv) = aT(u) + bT(v). 

(i) Let T(au + by) = aT(u) + bT(v). Show that T 
preserves the properties of vector addition and 
scalar multiplication by choosing appropriate 
values of a and b. 


(ii) To prove the statement in the other direction, 
assume that T is a linear transformation. Use the 
properties and definition of a linear transformation 
to show that T(au + bv) = aT(u) + bT(v). 
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6.2 The Kernel and Range of a Linear Transformation 


Find the kernel of a linear transformation. 


Find a basis for the range, the rank, and the nullity of a linear 
transformation. 


Determine whether a linear transformation is one-to-one or onto. 


J Determine whether vector spaces are isomorphic. 


THE KERNEL OF A LINEAR TRANSFORMATION 


You know from Theorem 6.1 that for any linear transformation T: V — W, the zero vector 
in V maps to the zero vector in W. That is, 7(0) = 0. The first question you will consider 
in this section is whether there are other vectors v such that T(v) = 0. The collection of all 
such elements is the kernel of 7. Note that the symbol 0 represents the zero vector in both 
V and W, although these two zero vectors are often different. 


Definition of Kernel of a Linear Transformation 


Let T: VW be a linear transformation. Then the set of all vectors v in V that 
satisfy T(v) = 0 is the kernel of T and is denoted by ker(7). 


Sometimes the kernel of a transformation can be found by inspection, as 
demonstrated in Examples 1, 2, and 3. 


EXAMPLE 1 Finding the Kernel of a Linear Transformation 


Let T: M,,—>M,, be the linear transformation that maps a 3 x 2 matrix A to its 
transpose. That is, 7(A) = A’. Find the kernel of T. 
SOLUTION 


For this linear transformation, the 3 x 2 zero matrix is clearly the only matrix in M;, 
whose transpose is the zero matrix in M, 3. So, the kernel of T consists of a single 
element: the zero matrix in M, 5. | 


i The Kernels of the Zero and 
EXAMPLE 2 Identity Transformations 
a. The kernel of the zero transformation T: V—>W consists of all of V because 


T(v) = 0 for every v in V. That is, ker(T) = V. 


b. The kernel of the identity transformation T: V— V consists of the single element 0. 
That is, ker(T) = {0}. | 


EXAMPLE 3 Finding the Kernel of a Linear Transformation 


Find the kernel of the projection T: R? — R? represented by T(x, y, z) = (x, y, 0). 
SOLUTION 


This linear transformation projects the vector (x, y, z) in R? to the vector (x, y, 0) in the 
xy-plane. The kernel consists of all vectors lying on the z-axis. That is, 


T(x, y, 2) = 
(x, y, 0) 


The kernel of T is the set 
of all vectors on the z-axis. 


Figure 6.1 ker(T) = {(0, 0, z): z is a real number}. (See Figure 6.1.) a 
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Figure 6.2 


Kernel: 
td, -1, 1) 


Finding the kernels of the linear transformations in Examples 1, 2, and 3 is 
relatively easy. Sometimes, the kernel of a linear transformation is not so obvious, as 
illustrated in the next two examples. 


EXAMPLE 4 Finding the Kernel of a Linear Transformation 


Find the kernel of the linear transformation T: R? > R? represented by 
T(x X2) = (x, — 2x5, 0, —x)). 

SOLUTION 

To find ker(7), you need to find all x = (x,, x,) in R? such that 
T(x1,%5) = (x, — 2x5, 0, —x,) = (0, 0, 0). 


This leads to the homogeneous system 


=H) =0 
which has only the trivial solution (x,, x) = (0, 0). So, you have 


ker(T) = {(0, 0)} = {0}. a 


EXAMPLE 5 Finding the Kernel of a Linear Transformation 


Find the kernel of the linear transformation T: R? — R? defined by T(x) = Ax, where 


i =f. =% 
a=| i 2 al 
SOLUTION 


The kernel of T is the set of all x = (x,, x5, X3) in R? such that T(x,, x, x3) = (0, 0). 
From this equation, you can write the homogeneous system 


x 

1 -1 -2]}"! A X,— XX — 2x, =0 

= —_> 1 2 3 
|i 2 || *2 lo ~x, + 2x, + 3x, = 0. 
X3 

Writing the augmented matrix of this system in reduced row-echelon form produces 
| 0 =1 0 
0 1 1 0 


xX, = k 


Xy = —X3. 


Using the parameter t = x, produces the family of solutions 


xy t 1 
x,| =] —-t]=t)-1). 
X3 t 1 


So, the kernel of T is 
ker(T) = {t(1, — 1, 1): tis areal number} = span{(1, — 1, 1)}. (See Figure 6.2.) 


Note in Example 5 that the kernel of T contains infinitely many vectors. Of 
course, the zero vector is in ker(7), but the kernel also contains such nonzero vectors 
as (1, —1, 1) and (2, —2, 2), as shown in Figure 6.2. The figure also shows that the 
kernel is a line passing through the origin, which implies that it is a subspace of R°. 
Theorem 6.3 on the next page states that the kernel of every linear transformation 
T: V— W is a subspace of V. 
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REMARK 


The kernel of T is sometimes 
called the nullspace of T. 


DISCOVERY 


1. What is the rank of 
the matrix Ain 
Example 6? 


2 Formulate a conjecture 


relating the dimension 
of the kernel, the rank, 
and the number of 
columns of A. 

Verify your conjecture 
for the matrix in 
Example 5. 
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THEOREM 6.3 The Kernel Is a Subspace of V 


The kernel of a linear transformation T: V— W is a subspace of the domain V. 


PROOF 


From Theorem 6.1, you know that ker(7) is a nonempty subset of V. So, by Theorem 4.5, 
you can show that ker(7) is a subspace of V by showing that it is closed under vector 
addition and scalar multiplication. To do so, let u and v be vectors in the kernel of T. 
Then 7(u + v) = T(u) + T(v) = 0 + 0 = 0, which implies that u + v is in the 
kernel. Moreover, if c is any scalar, then T(cu) = cT(u) = c0 = 0, which implies that 
cu is in the kernel. 


The next example shows how to find a basis for the kernel of a transformation 
defined by a matrix. 


EXAMPLE 6 Finding a Basis for the Kernel 


Define T: R° > R* by T(x) = Ax, where x is in R° and 


12 0 41-1 
3 1i 3 1i 0 
ES | 0-2 0 lf 
0 0 0 2 8 


Find a basis for ker(T) as a subspace of R5. 


SOLUTION 


Using the procedure shown in Example 5, write the augmented matrix [A 0] in reduced 
row-echelon form as shown below. 


1 0 2 0-1 0 
x, = —2x,+ x 
© tf =i @ =2 Q i ; 5 
-7 = + 
0 0 0 1 4 0 o “i 
0 0 0 0 0 Ọ äi i 
Letting x, = s and x; = t, you have 
Xi =25 + t =2 1 
Xy s+ 2t 1 2 
X= ]X3] = s+ Or} =s} 1} +f) O}. 
X4 Os — 4t 0 —4 
Xs Os + t 0 1 
So a basis for the kernel of T is B = {(—2, 1, 1, 0, 0), (1, 2, 0, —4, 1)}. 


In the solution of Example 6, a basis for the kernel of T was found by solving 
the homogeneous system represented by Ax = 0. This procedure is a familiar one— 
it is the same procedure used to find the nullspace of A. In other words, the kernel 
of T is the solution space of Ax = 0, as stated in the corollary to Theorem 6.3 
below. 


THEOREM 6.3 Corollary 


Let T: R” — R” be the linear transformation T(x) = Ax. Then the kernel of T is 
equal to the solution space of Ax = 0. 
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Domain Kernel 


Range 


Figure 6.3 


THE RANGE OF A LINEAR TRANSFORMATION 


The kernel is one of two critical subspaces associated with a linear transformation. The 
other is the range of T, denoted by range(T). Recall from Section 6.1 that the range of 
T: V— W is the set of all vectors w in W that are images of vectors in V. That is, 


range(T) = {T(v): v is in V}. 


THEOREM 6.4 The Range of T Is a Subspace of W 


The range of a linear transformation T: V— W is a subspace of W. 


PROOF 


The range of T is nonempty because 7(0) = 0 implies that the range contains the 
zero vector. To show that it is closed under vector addition, let T(u) and T(v) be 
vectors in the range of T. The vectors u and v are in V, so it follows that u + v is also 
in V, and the sum 


Tíu) + T(v) = T(u + v) 


is in the range of T. 

To show closure under scalar multiplication, let T(u) be a vector in the range of 
T and let c be a scalar. u is in V, so it follows that cu is also in V, and the scalar 
multiple cT(u) = T(cu) is in the range of T. a 


Note that the kernel and range of a linear transformation T: V — W are subspaces 
of V and W, respectively, as illustrated in Figure 6.3. 

To find a basis for the range of a linear transformation T(x) = Ax, observe that 
the range consists of all vectors b such that the system Ax = b is consistent. Writing 
the system 


ai i2 Ain || *1 bı 
an an on |) X2} _ b, 
Am T Am2 amn Xn m 
in the form 
ay i2 ain b, 
a a a b 
Ax=x,| Alta Itea Z=] 7b 
anm 1 Am2 amn Dy, 


shows that b is in the range of T if and only if b is a linear combination of the 
column vectors of A. So the column space of the matrix A is the same as the 
range of T. 


THEOREM 6.4 Corollary 


Let T: R” — R” be the linear transformation T(x) = Ax. Then the column space 
of A is equal to the range of T. 


In Examples 4 and 5 in Section 4.6, you saw two procedures for finding a basis for 
the column space of a matrix. The next example uses the procedure from Example 5 
in Section 4.6 to find a basis for the range of a linear transformation defined by 
a matrix. 
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z Finding a Basis for the Range 
EXAMPLE 7 of a Linear Transformation 
See LarsonLinearAlgebra.com for an interactive version of this type of example. 


For the linear transformation R° > R* from Example 6, find a basis for the range of T. 


SOLUTION 
Use the reduced row-echelon form of A from Example 6. 
1 2 0 1 =l 1 0 2 0 =1 
ee 2 1 3 1 0 0 1. =1 0 =2 
=] 0 =2 0 1 0 0 0 1 4 
0 0 0 2 8 0 0 0 0 0 


The leading 1’s appear in columns 1, 2, and 4 of the reduced matrix on the right, so the 
corresponding column vectors of A form a basis for the column space of A. A basis for 
the range of T is B = {(1, 2, — 1, 0), (2, 1, 0, 0), (1, 1, 0, 2)}. 


The next definition gives the dimensions of the kernel and range of a linear 
REMARK transformation. 


If Tis given by a matrix A, then 
the rank of Tis equal to the 
rank of A, and the nullity of T 
is equal to the nullity of A, as Let T: VW be a linear transformation. The dimension of the kernel of T is 
defined in Section 4.6. called the nullity of T and is denoted by nullity(7). The dimension of the range 
of T is called the rank of T and is denoted by rank(7). 


Definition of Rank and Nullity of a Linear Transformation 


In Examples 6 and 7, the rank and nullity of T are related to the dimension of the 
domain as shown below. 


rank(T) + nullity(7) = 3 + 2 = 5 = dimension of domain 


This relationship is true for any linear transformation from a finite-dimensional vector 
space, as stated in the next theorem. 


THEOREM 6.5 Sum of Rank and Nullity 


Let T: VW be a linear transformation from an n-dimensional vector space V 
into a vector space W. Then the sum of the dimensions of the range and kernel is 
equal to the dimension of the domain. That is, 


rank(7) + nullity(7) =n or dim(range) + dim(kernel) = dim(domain). 


PROOF 


The proof provided here covers the case in which T is represented by an m x n matrix 
A. The general case will follow in the next section, where you will see that any linear 
transformation from an n-dimensional space into an m-dimensional space can be 
represented by a matrix. To prove this theorem, assume that the matrix A has a rank 
of r. Then you have 


rank(T) = dim(range of T) = dim(column space) = rank(A) = r. 
From Theorem 4.17, however, you know that 
nullity(7) = dim(kernel of T) = dim(solution space of Ax = 0) = n — r. 
So, it follows that rank(7) + nullity(7) = r + (n—r) =n. a 
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= 
a 
(m 
Ii -= 
= 


—— § Finding the Rank and Nullity 
EXAMPLE 8 of a Linear Transformation 


Find the rank and nullity of the linear transformation T: R? — R? defined by the matrix 


1 0 =2 
A=/0 1 1). 
0 0 0 
SOLUTION 


A is in reduced row-echelon form and has two nonzero rows, so it has a rank of 2. This 
means that the rank of T is also 2, and the nullity is dim(domain) — rank = 3 — 2 = 1. 


One way to visualize the relationship between the rank and the nullity of a linear 
transformation provided by a matrix in row-echelon form is to observe that the number 
of leading 1’s determines the rank, and the number of free variables (columns without 
leading 1’s) determines the nullity. Their sum must be the total number of columns in the 
matrix, which is the dimension of the domain. In Example 8, the first two columns have 


leading 1’s, indicating that the rank is 2. The third column corresponds to a free 
variable, indicating that the nullity is 1. 


ma I] Finding the Rank and Nullity 
EXAMPLE 9 of a Linear Transformation 
Let T: R5 > R’ be a linear transformation. 
a. Find the dimension of the kernel of T when the dimension of the range is 2. 


b. Find the rank of T when the nullity of T is 4. 
c. Find the rank of T when ker(T) = {0}. 


SOLUTION 
a. By Theorem 6.5, with n = 5, you have 


dim(kernel) = n — dim(range) = 5 — 2 = 3. 
b. Again by Theorem 6.5, you have 
rank(T) = n — nullity(T) = 5 — 4 = 1. 
c. In this case, the nullity of T is 0. So 
rank(T) = n — nullity(T) = 5 — 0 = 5. i 


LINEAR A control system, such as the one shown for a dairy factory, 

ALGEBRA processes an input signal x, and produces an output signal 
Xx+1: Without external feedback, the difference equation 

APPLIED X,,1, = AX,, a linear transformation where x; is an n x 1 
vector and A is an n x n matrix, can model the relationship 
between the input and output signals. Typically, however, 
a control system has external feedback, so the relationship 
becomes Xg}; = Ax, + Bu,, where Bis an n x m matrix 
and u, is an m x 1 input, or control, vector. A system is 
controllable when it can reach any desired final state from 
its initial state in n or fewer steps. If A and B are matrices 
in a model of a controllable system, then the rank of the 
controllability matrix 


[B AB A2B... A-'B] 


is equal to n. 
Mark Yuill/Shutterstock.com 
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ONE-TO-ONE AND ONTO LINEAR TRANSFORMATIONS 


This section began with a question: Which vectors in the domain of a linear 
transformation are mapped to the zero vector? Theorem 6.6 (below) states that if the 
zero vector is the only vector v such that 7(v) = 0, then T is one-to-one. A function 
T: V— W is one-to-one when the preimage of every w in the range consists of a single 
vector, as shown below. This is equivalent to saying that T is one-to-one if and only if, 
for all u and v in V, T(u) = T(v) implies u = v. 


One-to-one 


Not one-to-one 


THEOREM 6.6 One-to-One Linear Transformations 


Let T: VW be a linear transformation. Then T is one-to-one if and only if 
ker(T) = {0}. 


PROOF 


First assume that T is one-to-one. Then 7(v) = 0 can have only one solution: v = 0. In 
that case, ker(T) = {0}. Conversely, assume that ker(T) = {0} and T(u) = T(v). You 
know that T is a linear transformation, so it follows that 


Tíu — v) = Tlu) — T(v) = 0. 


This implies that the vector u — v lies in the kernel of T and must equal 0. So, u = v, 
which means that T is one-to-one. | 


a] One-to-One and Not One-to-One 
EXAMPLE 10 Linear Transformations 


a. The linear transformation T: M,„„— M,,,,, represented by T(A) = A’ is one-to-one 


m,n n,m 


because its kernel consists of only the m x n zero matrix. 


b. The zero transformation T: R? — R? is not one-to-one because its kernel is all 


of R°. | 
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A function T: V— W is onto when every element in W has a preimage in V. In 
other words, T is onto when W is equal to the range of 7. The proof of the related 
theorem below is left as an exercise. (See Exercise 69.) 


THEOREM 6.7 Onto Linear Transformations 


Let T: V— W be a linear transformation, where W is finite dimensional. Then T 
is onto if and only if the rank of T is equal to the dimension of W. 


For vector spaces of equal dimensions, you can combine the results of Theorems 6.5, 
6.6, and 6.7 to obtain the next theorem relating the concepts of one-to-one and onto. 


THEOREM 6.8 One-to-One and Onto Linear Transformations 


Let T: VW be a linear transformation with vector spaces V and W, both of 
dimension n. Then T is one-to-one if and only if it is onto. 


PROOF 


If T is one-to-one, then by Theorem 6.6 ker(T) = {0}, and dim(ker(7)) = 0. In that 
case, Theorem 6.5 produces 


dim(range of T) = n — dim(ker(T)) = n = dim(W). 
Consequently, by Theorem 6.7, T is onto. Similarly, if T is onto, then 

dim(range of T) = dim(W) = n 
which by Theorem 6.5 implies that dim(ker(7)) = 0. By Theorem 6.6, T is 
one-to-one. | 


The next example brings together several concepts related to the kernel and range 
of a linear transformation. 


EXAMPLE 11 Summarizing Several Results 


Consider the linear transformation T: R’—>R” represented by T(x) = Ax. Find the 
nullity and rank of 7, and determine whether T is one-to-one, onto, or neither. 


1 2 0 1 2 
a. A=/0 1 1 b. A =/0 1 
0 0 1 0 0 
1 2 0 
 A=(5 a || d. A = 1 1 
0 0 
SOLUTION 
Note that each matrix is already in row-echelon form, so its rank can be determined by 
inspection. 


Dim(range) Dim(kernel) 
T: R" >R” Dim(domain) — Rank(7) Nullity(7) | One-to-One Onto 


a. T: RÈ >R? 3 3 0 Yes Yes 
b. T: R > R? 2 2 0 Yes No 
c. T: RÈ > R? 3 2 1 No Yes 
d. T: R> R? 3 2 1 No No 
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REMARK 


Your study of vector spaces 
has included much greater 
coverage to R” than to other 
vector spaces. This preference 
for R” stems from its notational 
convenience and from the 
geometric models available 

for R? and R°. 
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ISOMORPHISMS OF VECTOR SPACES 


Distinct vector spaces such as R? and M}, can be thought of as being “essentially 
the same”—at least with respect to the operations of vector addition and scalar 
multiplication. Such spaces are isomorphic to each other. (The Greek word isos 
means “equal.”) 


Definition of Ilsomorphism 


A linear transformation T: V—> W that is one-to-one and onto is called an 
isomorphism. Moreover, if V and W are vector spaces such that there exists an 
isomorphism from V to W, then V and W are isomorphic to each other. 


Isomorphic vector spaces are of the same finite dimension, and vector spaces of the 
same finite dimension are isomorphic, as stated in the next theorem. 


THEOREM 6.9 Isomorphic Spaces and Dimension 


Two finite-dimensional vector spaces V and W are isomorphic if and only if they 
are of the same dimension. 


PROOF 


Assume V is isomorphic to W, where V has dimension n. By the definition of 
isomorphic spaces, you know there exists a linear transformation T: V— W that is 
one-to-one and onto. T is one-to-one, so it follows that dim(kernel) = 0, which also 
implies that 


dim(range) = dim(domain) = n. 


In addition, T is onto, so you can conclude that dim(range) = dim(W) = n. 

To prove the theorem in the other direction, assume V and W both have dimension 
n. Let B = {v,, V>,. . . , V,} be a basis for V, and let B’ = {w,, w,,. . ., w,} bea basis 
for W. Then an arbitrary vector in V can be represented as 


v= CV, + CoV +++ + + C,V, 


non 


and you can define a linear transformation T: V— W as shown below. 
T(v) = cyw, + Ow, ++ ++ + cW, 


Verify that this linear transformation is both one-to-one and onto. So, V and W are 
isomorphic. 


Example 12 lists some vector spaces that are isomorphic to R*. 


EXAMPLE 12 lsomorphic Vector Spaces 


The vector spaces below are isomorphic to each other. 

a. R* = 4-space 

b. M4, = space of all 4 x 1 matrices 

c. M, = space of all 2 x 2 matrices 

d. P} = space of all polynomials of degree 3 or less 

e. V = {(x,, X5, X3, X4, 0): x; is a real number} (subspace of R5) al 


Example 12 tells you that the elements in these spaces behave in the same way as 
an arbitrary vector v = (1, V5, V3, V4). 
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6.2 Exercises See CalcChat.com for worked-out solutions to odd-numbered exercises. 


Finding the Kernel of a Linear Transformation 
In Exercises 1-10, find the kernel of the linear 
transformation. 


1. T: R8 SR’, T(x, y, z) = (0, 0, 0) 
2. T: RÈ > R, T(x, y, z) = (x, 0, z) 
3. T: R* R4, T(x, y, z, w) = (y, x, w, z) 
4. T: RÈ > RÈ, T(x, y, z) = (—z, —y, —x) 
5. T: P;R, 
Tla + ax + ax? + ax?) = a, +a, 
. T: P, >R, Tag + a,x + ax?) = ay 
7. T: P >P}, Tag + ax + ax?) = a, + 2ayx 
8. T: P,P, 
T(dy + ax + ax? + 3x3) = a, + 2ayx + 3a,x? 
9. T: R > RÈ, T(x, y) = (x + 2y, y — x) 
10. T: R? > R?, T(x, y) = (x — y,y — x) 


N 


Finding the Kernel and Range In Exercises 11-18, 
define the linear transformation T by T(x) = Ax. Find 
(a) the kernel of T and (b) the range of T. 


1 2 1 2 
ma-E J mafi A 


1 = 2 | =2 1 
wa- g mai 4 
1 3 1 1 
15. A=]-1 -3 16 A=|-1 2 
2 2 0 1 
1 2 -=l 4 
3 1 2 =f 
Me A a og og asa 
=) =2 1 1 
=] 3 2 1 4 
18. A=] 2 3 5 0 0 
2 1 2 1 0 


Finding the Kernel, Nullity, Range, and Rank In 
Exercises 19-32, define the linear transformation T by 
T(x) = Ax. Find (a) ker(T), (b) nullity(7), (c) range(7), 


and (d) rank(7). 

= 1 3 2 
9. a=] i i 20.4=| 3 a 

5 -=3 4 1 
21. A=] 1 1 22. A=|0 0 

1. =l 2A -S 

2 3 1 5 
mat HOO aa S 

10 10. 26 26. 


ee SS 


1 0 1 1 0 0 
25. A=]0 1 0 26 A=|0 0 0 
1 0 1 0 0 1 
4 4 2 i 2 i 
9 9 9 —3 3 3 
7,A=|-5 5 -il MAH) 3 i 3 
2 _2 1 —1 2 gat 
9 9 9 3 3 3 
0-2 3 
2.a =| 0 a 
1 1 0 0 
wal T i 
2 2 -3 1 B 
= 1 1 1 1 -1 
} : = 
@31 A=|3 3 -5 0 14 
6 6 -2 4 16 
3 -2 6 -1 15 
©) 32. 4=ļ]|4 3 8 10-14 
2 -3 4 -4 20 


Finding the Nullity and Describing the Kernel and 
Range In Exercises 33—40, let T: R? — R? be a linear 
transformation. Find the nullity of T and give a geometric 
description of the kernel and range of T. 


33. rank(T) = 2 34. rank(T) = 1 
35. rank(T) = 0 36. rank(T) = 3 
37. T is the counterclockwise rotation of 45° about the 


z-axis: 
/2 J | 2 ) 
Ty.) = (Pe Deg rte 


38. T is the reflection through the yz-coordinate plane: 
T(x, y, z) = (=x, y, z) 
39. T is the projection onto the vector v = (1, 2, 2): 


T(x, y, z) = siara 
40. T is the projection onto the xy-coordinate plane: 
T(x, y, z) = (x, y, 0) 
Finding the Nullity of a Linear Transformation In 
Exercises 41—46, find the nullity of T. 
41. T: R*— RP, rank(T) = 2 
42. T: R*— R+, rank(T) = 0 
43. T: P;—> P,, rank(T) = 3 
44, T: P,; > P,, rank(T) = 2 
45. T: M,,—M,5, rank(T) = 4 
46. T: M,,—M,, rank(T) = 6 


(1, 2, 2) 
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Verifying That T Is One-to-One and Onto In Exercises 
47-50, verify that the matrix defines a linear function T 
that is one-to-one and onto. 

48. A= |; "| 


47. A= E l 


0 2 0 =I 
1 0 0 1 2 3 
49. A=]|0 0 1 50. A=|-1 2 4 
0 1 0 0 4 1 


Determining Whether T Is One-to-One, Onto, or 
Neither In Exercises 51-54, determine whether the 
linear transformation is one-to-one, onto, or neither. 


51. T in Exercise 3 52. T in Exercise 10 
53. T: R* > R?, T(x) = Ax, where A is given in Exercise 21 
54. T: R5 > R?, T(x) = Ax, where A is given in Exercise 18 


55. Identify the zero element and standard basis for each of 
the isomorphic vector spaces in Example 12. 


56. Which vector spaces are isomorphic to R6? 
(a) M33 (b) Pe (c) CLO, 6] 
(d) Me, (e) Ps C1 =3,3] 
(g) {x1 X2, X3, 0, Xs, Xg» X7): x; is a real number} 


57. Calculus Define T: P,P, by T(p) = p’. What is 
the kernel of T? 


58. Calculus Define T: P, > R by 


T(p) = Í p(x) dx. 


What is the kernel of T? 


59. Let T: R? > R? be the linear transformation that projects 
u onto v = (2, — 1, 1). 
(a) Find the rank and nullity of T. 
(b) Find a basis for the kernel of T. 


60. CAPSTONE Let T: R*-—>R® be the linear 
transformation represented by T(x) = Ax, where 


I =2 1 0 
1 2 3}. 

0 0 0 1 
(a) Find the dimension of the domain. 
(b) Find the dimension of the range. 
(c) Find the dimension of the kernel. 
(d) Is T one-to-one? Explain. 
(e) Is T onto? Explain. 


(f) Is T an isomorphism? Explain. 


61. For the transformation T: R’—R" represented by 
T(x) = Ax, what can be said about the rank of T when 
(a) det(A) # 0 and (b) det(A) = 0? 


6.2 Exercises 319 


62. Writing Let T: R” —R” be a linear transformation. 
Explain the differences between the concepts of 
one-to-one and onto. What can you say about m and n 
when T is onto? What can you say about m and n when 
T is one-to-one? 


63. Define T: M,,,,2>M,,, by T(A) = A — A’. Show that 


nn 
the kernel of T is the set of n x n symmetric matrices. 

64. Determine a relationship among m, n, j, and k such that 
M n,n 18 isomorphic to M,,. 


m,n 


True or False? In Exercises 65 and 66, determine 
whether each statement is true or false. If a statement 
is true, give a reason or cite an appropriate statement 
from the text. If a statement is false, provide an example 
that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


65. (a) The set of all vectors mapped from a vector 
space V into another vector space W by a linear 
transformation T is the kernel of T. 


(b) The range of a linear transformation from a vector 
space V into a vector space W is a subspace of V. 


(c) The vector spaces R? and M, , are isomorphic to 
each other. 


66. (a) The dimension of a linear transformation T from a 
vector space V into a vector space W is the rank of T. 


(b) A linear transformation T from V into W is 
one-to-one when the preimage of every w in the 
range consists of a single vector v. 


(c) The vector spaces R? and P, are isomorphic to each 
other. 


67. Guided Proof Let B be an invertible n x n matrix. 
Prove that the linear transformation T: M, „Mnn 
represented by 7(A) = AB is an isomorphism. 

Getting Started: To show that the linear transformation 
is an isomorphism, you need to show that T is both onto 
and one-to-one. 


(i) T is a linear transformation with vector spaces of 
equal dimension, so by Theorem 6.8, you only 
need to show that T is one-to-one. 


Gi) To show that T is one-to-one, you need to 
determine the kernel of T and show that it is {0} 
(Theorem 6.6). Use the fact that B is an invertible 
n x n matrix and that T(A) = AB. 


(iii) Conclude that T is an isomorphism. 


68. Proof Let 7: V— W bea linear transformation. Prove 
that T is one-to-one if and only if the rank of T equals 
the dimension of V. 


69. Proof Prove Theorem 6.7. 


70. Proof Let T:V—W be a linear transformation, 
and let U be a subspace of W. Prove that the set 
T-!(U) = {v € V: T(v) E U} is a subspace of V. What 
is T~'(U) when U = {0}? 
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6.3 Matrices for Linear Transformations 


Find the standard matrix for a linear transformation. 


Find the standard matrix for the composition of linear transformations 
and find the inverse of an invertible linear transformation. 


wi Find the matrix for a linear transformation relative to a 
nonstandard basis. 


THE STANDARD MATRIX FOR A LINEAR 
TRANSFORMATION 


Which representation of T: R? — R? is better: 
T (Sis Ri Bq) = OR PR = Fy Hy FG Oe, Oe, F i) 
or 


2 1 -Ilfx 
T(x) = Ax =|-1 3 —2]| x, |? 
0 3 alx 


The second representation is better than the first for at least three reasons: it is simpler to 
write, simpler to read, and easier to enter into a calculator or math software. Later, you 
will see that matrix representation of linear transformations also has some theoretical 
advantages. In this section, you will see that for linear transformations involving 
finite-dimensional vector spaces, matrix representation is always possible. 

The key to representing a linear transformation T: V — W by a matrix is to determine 
how it acts on a basis for V. Once you know the image of every vector in the basis, 
you can use the properties of linear transformations to determine T(v) for any v in V. 

Recall that the standard basis for R”, written in column vector notation, is 


B = {e,,@,...,€,} 


1] fo 0 
_ jf of fa 0 
o| Lo 1 


THEOREM 6.10 Standard Matrix for a Linear Transformation 


Let T: R” — R” be a linear transformation such that, for the standard basis 
vectors e; of R”, 


ay aiz 


a 
, T(e,) = 7 EE i E 


a a 


ml m2 amn 


Then the m x n matrix whose n columns correspond to T(e;) 


a 


mi 


is such that T(v) = Av for every v in R”. A is called the standard matrix for T. 
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PROOF 
To show that 7(v) = Av for any v in R”, you can write 
v=[v v... nE = vje + ve, +--+ +, ¢,. 


T is a linear transformation, so you have 


T(v) = T(v\e, T V2€2 Teee ven) 
= T(v,e,) + Tve) +- © © + Th, e, 
= v,T(e,) + v,T(e,) +- - - + v,T(e,). 


On the other hand, the matrix product Av is 


âi ai in || Y1 
a a a v 
E "21 22 2n 2 
amı Am2 Eag amn Va 
aV + AV Fs + Ay Vy 
— | aai + Ggyvg Ft + Aan, 
Ami V1 + Am2V2 apes 3 oP AmnYn 
ay aiz ain 
_ a1 an Mn 
=a ca fe Way a ae ae ee 
amı And amn 
= vT(e,) + vT(e,) +- - - + v,T(e,). 
So, T(v) = Av for each v in R”. | 


=e 5 Finding the Standard Matrix 
EXAMPLE 1 for a Linear Transformation 
See LarsonLinearAlgebra.com for an interactive version of this type of example. 
Find the standard matrix for the linear transformation T: R? — R? defined by 
T(x, y, z) = (x — 2y, 2x + y). 


SOLUTION 
Begin by finding the images of e,, e,, and e}. 


Vector Notation Matrix Notation 
: 1 
T(e,) = T(1, 0, 0) = (1, 2) =T | 01)= . 

REMARK 0 
As a check, note that 0 

x ica olly T(e,) = T(0, 1,0) = (—2, 1) T(e,) =T sf) 
A= |; 1 o y 0 
Z Z 0 

7 | x= ” T(e;) = T(0, 0, 1) = (0, 0) T(e,) =T a 
2x+ y - 1 

whichis equivalent to By Theorem 6.10, the columns of A consist of T(e,), 1), T(e,), and 7(e;), and you have 


T(x, y, Z) = (x — 2y, 2x + y). 


A =[T(e,) T(e,) T(e3)] = |; E o), | 
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Chapter 6 Linear Transformations 


A little practice will enable you to determine the standard matrix for a linear 
transformation, such as the one in Example 1, by inspection. For example, to find the 
standard matrix for the linear transformation 


Tis Mos x3) = Wi De, F Sra By F 3x At ay = 24) 
use the coefficients of x,, x,, and x, to form the rows of A, as shown below. 


| =2 5| <= 1x, — 2x, + 5x, 
A=}2 0 3) < 2x, + Ox, + 3x, 
4 1 -2| < 4x, + lx, — 2x, 


a Finding the Standard Matrix 
EXAMPLE 2 for a Linear Transformation 


The linear transformation T: R? — R? projects i 
each point in R? onto the x-axis, as shown at the T(x, y) = (x, 0) 
right. Find the standard matrix for T. (x, y) 


SOLUTION 


This linear transformation is represented by 


T(x, y) = (x, 0). 


So, the standard matrix for T is 


A =[T(1,0) T(0, 1)] (x, 0) 
7 F o) Projection onto the x-axis 
0 0 La 


The standard matrix for the zero transformation from R” into R” is the m x n zero 
matrix, and the standard matrix for the identity transformation from R” into R” is 1. 


LINEAR Ladder networks are useful tools for electrical engineers 

ALGEBRA involved in circuit design. In a ladder network, the output 
voltage Vand current / of one circuit are the input voltage 

APPLIED and current of the circuit next to it. In the ladder network 
shown below, linear transformations can relate the input and 
output of an individual circuit (enclosed in a dashed box). 
Using Kirchhoff’s Voltage and Current Laws and Ohm’s Law, 


[l-lum all 


and 


Pallo “lle 
I, 0 TL by 
A composition can relate the input and output of the entire 
ladder network, that is, V, and /, to V, and /;. Discussion on 


the composition of linear transformations begins on the 
next page. 


IN 
NAVV 
as] 
5 


any_keen/Shutterstock.com 
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COMPOSITION OF LINEAR TRANSFORMATIONS 
The composition, T, of T,: R” > R” with T,: R” > RP is 
Tv) = T,(T\(v)) 
where v is a vector in R”. This composition is denoted by 
T=T,°T,. 


The domain of T is the domain of T,. Moreover, the composition is not defined unless 
the range of T, lies within the domain of T,, as shown below. 


The next theorem emphasizes the usefulness of matrices for representing linear 
transformations. This theorem not only states that the composition of two linear 
transformations is a linear transformation, but also says that the standard matrix for 
the composition is the product of the standard matrices for the two original linear 
transformations. 


THEOREM 6.11 Composition of Linear Transformations 


Let Ti: R”—>R” and T,: R”—RP be linear transformations with standard 
matrices A, and A,, respectively. The composition T: R” — RP, defined by 


T(v) = T,(T,(v)), is a linear transformation. Moreover, the standard matrix A 
for T is the matrix product 


A = A,A.. 


PROOF 
To show that T is a linear transformation, let u and v be vectors in R” and let c be any 
scalar. T, and T, are linear transformations, so you can write 
T(u + v) = 7,(7,(u + v)) 

= T,(T,(u) + T,(v)) 

= T,(T,(u)) + T,(T,(v)) 

= T(u) + T(v) 

T(cv) = T,(T,(cv)) 

= T,(cT,(v) 

= cT,(T,(v)) 

= cT(y). 


Now, to show that A,A, is the standard matrix for T, use the associative property of 
matrix multiplication to write 


T(v) = T,(T,(v)) = T,(A,v) = A,(A,v) = (A,ADv. | 
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Chapter 6 Linear Transformations 


Theorem 6.11 can be generalized to cover the composition of n linear transformations. 
That is, if the standard matrices of T,,T,,. . ., T, are A}, A>, . . .,A,, respectively, 
then the standard matrix for the composition T(v) = T,(T,_,: + < (7,(T,(v)))- - -) is 
represented by A = A,A,,_,° + *A>Aj. 

Matrix multiplication is not commutative, so order is important when forming the 
compositions of linear transformations. In general, the composition T, ° T, is not the 


same as T} ° T,, as demonstrated in the next example. 


EXAMPLE 3 The Standard Matrix for a Composition 


Let T, and T, be linear transformations from R° into R? such that 


T(x, y, z) = (2x + y,0,x +z) and Tx, y,z) = (x — y, z, y). 
Find the standard matrices for the compositions T = T, ° T} and T’ = T; ° T). 


SOLUTION 


The standard matrices for T, and T, are 


2 í 0 1 -1 0 
A,=|0 0 of and 4=|0 0 ıl 
i 0 1 0 1 0 


By Theorem 6.11, the standard matrix for T is 


A=A,A, 
I =] 0}; 2 1 0 
=10 0 1/0 0 0 
0 1 0}/ 1 0 1 
2 1 0 
=|1 0 1 
0 0 0 
and the standard matrix for T’ is 
A’ = AA, 
2 1 -l 0 
= 0 0 1 
0 1 0 


KH OoOnFH OS 
| 

CoN OOF 

oorr oo 


Another benefit of matrix representation is that it can represent the inverse of a 
linear transformation. Before seeing how this works, consider the next definition. 


Definition of Inverse Linear Transformation 


If 7,: R” >R” and T,: R"— R” are linear transformations such that for every v 
mR”, 


T,(T,\(v)) =v and 7,(T7,(v)) =v 


then T, is the inverse of T}, and T; is said to be invertible. 


Not every linear transformation has an inverse. If the transformation T, is 
invertible, however, then the inverse is unique and is denoted by T,!. 


Copyright 2017 Cengage Learning. All Rights Reserved. May not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eBook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage Learning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


6.3 Matrices for Linear Transformations 325 


Just as the inverse of a function of a real variable can be thought of as undoing what 
the function did, the inverse of a linear transformation T can be thought of as undoing the 
mapping done by T. For example, if T is a linear transformation from R? into R° such that 


T(1,4,=5) = (2,3, 1) 
and if T~! exists, then T~! maps (2, 3, 1) back to its preimage under T. That is, 
T-(2, 3, 1) = (1, 4, —5). 


The next theorem states that a linear transformation is invertible if and only if it is an 
isomorphism (one-to-one and onto). You are asked to prove this theorem in Exercise 56. 


THEOREM 6.12 Existence of an Inverse Transformation 
REMARK 


Several other conditions are 
equivalent to the three listed in oe . 
Theorem 6.12; see the summary 1.7 = invertible. 

of equivalent conditions for 2. T is an isomorphism. 
square matrices in Section 4.6. 3. A is invertible. 


Let T: R” — R” be a linear transformation with standard matrix A. Then the 
conditions listed below are equivalent. 


If T is invertible with standard matrix A, then the standard matrix for T~! is A7!. 


EXAMPLE 4 Finding the Inverse of a Linear Transformation 


Consider the linear transformation T: R? > R? defined by 
T (x1, Xo, X3) = (2x, + 3x, + x3, 3x, + 3x, + x3, 2x, + 4x, + 2x3). 


Show that T is invertible, and find its inverse. 


SOLUTION 
The standard matrix for T is 
2 3 1 
A=]3 3 1 
2 4 1 


Using the method presented in Section 2.3 or a graphing calculator, you can find that 
A is invertible, and its inverse is 


=] 1 (0) 
A'=]-1 0 1). 
6 =2. -3 
So, T is invertible and the standard matrix for T~! is A7!. 


Using the standard matrix for the inverse, you can find the rule for T~! by 
computing the image of an arbitrary vector x = (x), x5, x3). 


-1 1. Olfx, 
AIX 


ll 
| 
=n 
© 
= 
ta 
N 


II 
| 
mal 
I ae 
tad 
w 


T(x, X2 X3) = (~x; + x =x] + xX, 6x = 2x, = 3x3). 
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NONSTANDARD BASES AND GENERAL VECTOR SPACES 


You will now consider the more general problem of finding a matrix for a linear 
transformation T: V— W, where B and B’ are ordered bases for V and W, respectively. 
Recall that the coordinate matrix of v relative to B is denoted by [v],. To represent the 
linear transformation T, multiply A by a coordinate matrix relative to B to obtain a 
coordinate matrix relative to B'. That is, [T(v)],, = Alv],. The matrix A is called the 
matrix of T relative to the bases B and B’. 

To find the matrix A, you will use a procedure similar to the one used to find the 
standard matrix for T. That is, the images of the vectors in B are written as coordinate 
matrices relative to the basis B’. These coordinate matrices form the columns of A. 


Transformation Matrix for Nonstandard Bases 


Let V and W be finite-dimensional vector spaces with bases B and B’, 
respectively, where 


B = {v}, Vn. - +> Vyb- 


If T: V— W is a linear transformation such that 


ay 12 


[Tv]; = 2 , [T0]; = - 95-0 TO = 


amı Ang 


then the m x n matrix whose n columns correspond to [T(v,) |, 


amı Ang 


is such that [T(v)],, = A[v], for every v in V. 


iz s Ææ Finding a Matrix Relative 
SONNE to Nonstandard Bases 


Let T: R? — R? be a linear transformation defined by T(x,, x.) = (x, + X2, 2x; — x). 
Find the matrix for T relative to the bases 


yi Vo Ww) Wo 


B= {(1,2),(-1, )} and B’ = {(1, 0), (0, 1}. 


SOLUTION 

By the definition of T, you have 
T(v,) = T(1, 2) = (3, 0) = 3w, + Ow, 
T(v,) = T(-1, 1) = (0, —3) = Ow, — 3wy. 


The coordinate matrices for T(v,) and T(v,) relative to B’ are 


[rv = || and trod) S| 


Form the matrix for T relative to B and B’ by using these coordinate matrices as 
columns to produce 


ae a 
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z Using a Matrix to Represent 
EXAMPLE 6 a Linear Transformation 
For the linear transformation T: R? — R? in Example 5, use the matrix A to find T(v), 


where v = (2, 1). 


SOLUTION 
Using the basis B = {(1, 2), (— 1, 1)}, you find that v = (2, 1) = 1(1,2) — 1(—1, 1), 
which implies 


[v]; =[1 —1]*. 
So, [T(v)]; is 


avela sll- GI 


Finally, B’ = {(1, 0), (0, 1)}, so it follows that 
T(v) = 3(1, 0) + 3(0, 1) = (3, 3). 


Check this result by directly calculating T(v) using the definition of T in 
Example 5: T(2, 1) = (2 + 1, 2(2) — 1) = (3, 3). 


For the special case where V = W and B = B’, the matrix A is called the matrix 
of T relative to the basis B. In this case, the matrix of the identity transformation is 
simply J,. To see this, let B = {v}, V2, . . ., V„}. The identity transformation maps 
each v; to itself, so you have [7(v,)], = [1 0. . .0]", [T(v>)] = [0 1. ..0]%..., 
[T(v)]s = [0 0. . . 1]f, and it follows that A = [,. 

In the next example, you will construct a matrix representing the differential 
operator discussed in Example 10 in Section 6.1. 


EXAMPLE 7 A Matrix for the Differential Operator (Calculus) 


Let D,: P, > P; be the differential operator that maps a polynomial p of degree 2 or less 
onto its derivative p’. Find the matrix for D, using the bases 


B= {1,x, xX} and B’ = {1, x}. 
SOLUTION 
The derivatives of the basis vectors are 


D1) = 0 = 0(1) + 0@) 
D(x) = 1 = 101) + 0x) 
D(x?) = 2x = 0(1) + 2(x). 


So, the coordinate matrices relative to B’ are 
0 1 0 
(le = [0] Wee =[5] ee = [9] 


and the matrix for D, is 


0 1 0 
A= ; 
b 0 | 
Note that this matrix does produce the derivative of a quadratic polynomial 
p(x) = a+ bx + cx’. 


a 
_fo 1 gf fo 7 : 
ap =|? 0 alfel = Lac] = P + 2er= Dla + br + o 
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6.3 Exercises 


See CalcChat.com for worked-out solutions to odd-numbered exercises. 


The Standard Matrix for a Linear Transformation @ Finding the Standard Matrix and the Image In 


In Exercises 1-6, find the standard matrix for the linear 
transformation T. 


1. T(x, y) = (x + 2y, x — 2y) 

. T(x, y) = (2x — 3y,x — y, y — 4x) 
. T(x, y, z) = (x + y, x — y,z — x) 
. T(x, y) = (5x + y, 0, 4x — Sy) 

. T(x, y, z) = (3x — 2z, 2y — z) 

< T(xi» X2, X3, x4) = (0, 0, 0, 0) 


AnA URN 


Finding the Image of a Vector In Exercises 7-10, use 
the standard matrix for the linear transformation T to 
find the image of the vector v. 


7. T(x, y, z) = (2x + y, 3y — z), v= (0,1,—1) 
8. T(x, y) = (x + y, x — y, 2x, 2y), v= (3, —3) 
9. T(x, y) = (x — 3y, 2x + y, y), v= (—2,4) 
10. Tijs Xa X35 x4) = (x, = Nai Ny = Ky Be = Hyp Hoo t Ke); 
v = (1, 2, 3, —2) 


Finding the Standard Matrix and the Image In 

Exercises 11-22, (a) find the standard matrix A for the 

linear transformation T, (b) use A to find the image of 

the vector v, and (c) sketch the graph of v and its image. 

11. Tis the reflection in the origin in R*: T(x, y) = (—x, —y), 
v = (3,4). 

12. Tis the reflection in the line y = xin R?: T(x, y) = (y, x), 
v = (3, 4). 

13. T is the reflection in the y-axis in R?: T(x, y) = (—x, y), 
v = (2, —3). 

14. T is the reflection in the x-axis in R?: T(x, y) = (x, — y), 
v= (4, -1). 

15. T is the counterclockwise rotation of 45° in R?, 
v = (2, 2). 

16. T is the counterclockwise rotation of 120° in R?, 
v = (2, 2). 

17. T is the clockwise rotation (0 is negative) of 60° in R?, 
v = (1, 2). 

18. T is the clockwise rotation (0 is negative) of 30° in R?, 
v = (2, 1). 

19. T is the reflection in the xy-coordinate plane in 
RÈ: T(x, y, z) = (x, y, —z), v = (3, 2, 2). 

20. T is the reflection in the yz-coordinate plane in 
R3: T(x, y, z) = (—x, y, z), v = (2, 3, 4). 

21. T is the projection onto the vector w = (3,1) in 
R?: T(v) = projyv, v = (1, 4). 

22. T is the reflection in the vector w = (3,1) in 
R?: T(v) = 2 proj,v — v, v = (1, 4). 


Exercises 23-26, (a) find the standard matrix A for the 
linear transformation T and (b) use A to find the image 
of the vector v. Use a software program or a graphing 
utility to verify your result. 
23. T(x, y, z) = (2x + 3y = z, 3x = 2z,2x =y + 2), 
v = (1,2, -1) 
24. T(x, y, z) = (x + 2y — 3z, 3x — 5y, y — 3z), 
v = (3, 13, 4) 
25. Ts Xos X55 x4) = 
M = (1, 0, 1, -1) 
26. Tis Xas X3,X4) = (x, + 2x, X> = X,, 2x3 = Xy, X,), 


v= (0,1, —1, 1) 


Gi =A F= k), 


Finding Standard Matrices for Compositions In 
Exercises 27-30, find the standard matrices A and A’ for 
T = T, ° T; and T’ = T; ° T}. 
27. T,: RR—>R?, T,(x, y) = (x — 2y, 2x + 3y) 
Ty: R? > R, T(x, y) = (y, 0) 
1: RB >R, T,(x, y, z) = (x, y, z) 
5: R? > R?, T,(x, y, z) = (0, x, 0) 
29. T,: R? > R, T,(x, y) = (—2x + 3y, x + y, x — 2y) 
T,: RÈ > RÈ, T,(x, y, z) = (x — 2y, z + 2x) 
30. Ti: R? > R?, T(x, y) = (x, y, y) 
T,: RÈ > R?, T,(x, y, z) = (y, z) 


28. 


Finding the Inverse of a Linear Transformation 
In Exercises 31-36, determine whether the linear 
transformation is invertible. If it is, find its inverse. 


31. T(x, y) = (— 4x, 4y) 32. T(x, y) = (2x, 0) 

33. T(x, y) = (x + y, 3x + 3y) 

34. T(x, y) = (x + y,x — y) 

35. Tt te) = ey taa t aa t) 

36. Txi; Xz, Xz, X4) = Wy — 2x, Xz, X3 F Xy X3) 

Finding the Image Two Ways In Exercises 37—42, 


find T(v) by using (a) the standard matrix and (b) the 
matrix relative to B and B’. 


37. T: R? > R°, T(x, y) = (x + y, x, y), v = (5, 4), 
B = į(1, — 1), (0, 1)}, 
B' = {(1, 1, 0), (0, 1, 1), (1, 0, 1)} 
38. T: RÈ —>R?, T(x, y, z) = (x — y, y — z), v = (2, 4, 6), 
B = {(1, 1, 1), (1, 1, 0), (0, 1, 1)}, B’ = {(1, 1), (2, 1)} 
39. T: R? > R4, T(x, y, z) = (2x,x+ y,y+ zx + 2), 
v = (1, —5, 2), B = {(2, 0, 1), (0, 2, 1), (1, 2, 1)}, 
B' = {(1, 0, 0, 1), (0, 1, 0, 1), (1, 0, 1, 0), (1, 1, 0, 0)} 
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40. 


41. 


42. 


43. 


44. 


45. 


46. 
47. 


48. 


49. 


51 


T: R* > RP, 

T (X15 Xo) X35 Xq) = (xy +X + X53 + Hy, x4 — X), 

v = (4, —3, 1, 1), 

B = {(1, 0, 0, 1), (0, 1, 0, 1), (1, 0, 1, 0), (1, 1, 0, 0)}, 
B' = {(1, 1), (2, 0)} 

T: R? > R?, T(x, y, z) = (x + y + z, 2z — x, 2y — 2), 
v = (4, —5, 10), B = {(2, 0, 1), (0, 2, 1), (1, 2, 1)}, 
B' = {(1, 1, 1), (1, 1, 0), (0, 1, 1)} 

T: R? > R?, T(x, y) = (3x — 13y, x — 4y), v = (4, 8), 
B = B' = {(2, 1), (5, 1)} 

Let T: P, > P, be the linear transformation T(p) = xp. 


Find the matrix for T relative to the bases B = {1, x, x?} 
and B’ = {1, x, x2, x}. 


Let T: P, — P, be the linear transformation T(p) = x?p. 
Find the matrix for T relative to the bases B = {1, x, x?} 
and B’ = {1, x, x7, x3, x*}. 

Calculus Let B = {1,x,e*,xe*} be a basis for a 
subspace W of the space of continuous functions, and 
let D, be the differential operator on W. Find the matrix 
for D, relative to the basis B. 

Calculus Repeat Exercise 45 for B = {e”, xe, x7e*}. 
Calculus Use the matrix from Exercise 45 to evaluate 
D,[4x — 3xe*]. 

Calculus Use the matrix from Exercise 46 to evaluate 
Di[Se" = 3xe™ + ee", 

Calculus Let B = {1, x, x?, x°} be a basis for P}, and 
T: = P, —> P, be the linear transformation represented by 


ne fea 
0 


(a) Find the matrix A for T with respect to B and the 
standard basis for P}. 


(b) Use A to integrate p(x) = 8 — 4x + 3x°. 


50. CAPSTONE 


(a) Explain how to find the standard matrix for a 
linear transformation. 


(b) Explain how to find a composition of linear 
transformations. 


(c) Explain how to find the inverse of a linear 
transformation. 


(d) Explain how to find the transformation matrix 
relative to nonstandard bases. 


. Define T: M, , >M; by T(A) = A’. 
(a) Find the matrix for T relative to the standard bases 
for M, , and M; 3. 


(b) Show that T is an isomorphism. 


(c) Find the matrix for the inverse of T. 


52. 


6.3 Exercises 329 


Let T be a linear transformation such that T(v) = kv for 
v in R”. Find the standard matrix for T. 


True or False? In Exercises 53 and 54, determine 
whether each statement is true or false. If a statement 
is true, give a reason or cite an appropriate statement 
from the text. If a statement is false, provide an example 
that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


53. 


54. 


55. 


56. 
57. 


58. 


(a) If T: R” — R” is a linear transformation such that 


T(e,) = Lay, Ag, ++: Am | 
Ties) = [a dy . -aml 
T(e,,) = [a;n An ea ial 


then the m x n matrix A = [a,] whose columns 
correspond to T(e,) and is such that T(v) = Av for 
every v in R” is called the standard matrix for T. 


(b) All linear transformations T have a unique inverse 
T, 

(a) The composition T of linear transformations T; 
and T,, represented by T(v) = T,(T,(v)), is defined 
when the range of T, lies within the domain of T,. 

(b) In general, the compositions T, ° T) and T, °T, 
have the same standard matrix A. 


Guided Proof Let 7,;:V-V and T,:V—>V be 
one-to-one linear transformations. Prove that the 
composition T = T, e T) is one-to-one and that T~! 
exists and is equal to T7! e Ty 1. 
Getting Started: To show that T is one-to-one, use the 
definition of a one-to-one transformation and show that 
T(u) = T(v) implies u = v. For the second statement, 
you first need to use Theorems 6.8 and 6.12 to show that 
T is invertible, and then show that T° (T7! © T5 !) and 
(TI! °T5') o T are identity transformations. 
(i) Let7(u) = T(v).Recallthat(7, ° T,)(v) = T,(T,(v)) 
for all vectors v. Now use the fact that T, and T, 
are one-to-one to conclude that u = v. 


Use Theorems 6.8 and 6.12 to show that 7), T}, 
and T are all invertible transformations. So, Ty! 
and T;! exist. 


(ii) 


(iii) Form the composition T’ = Tī! T5 '. It is a 
linear transformation from V into V. To show 
that it is the inverse of T, you need to determine 
whether the composition of T with T’ on both sides 
gives an identity transformation. 


Proof Prove Theorem 6.12. 


Writing Is it always preferable to use the standard 
basis for R”? Discuss the advantages and disadvantages 
of using different bases. 


Writing Look back at Theorem 4.19 and rephrase it 
in terms of what you have learned in this chapter. 
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Chapter 6 Linear Transformations 


.4 Transition Matrices and Similarity 


zi Find and use a matrix for a linear transformation. 


Show that two matrices are similar and use the properties of 
similar matrices. 


THE MATRIX FOR A LINEAR TRANSFORMATION 


In Section 6.3, you saw that the matrix for a linear transformation T: V — V depends on 
the basis for V. In other words, the matrix for T relative to a basis B is different from 
the matrix for T relative to another basis B’. 

A classical problem in linear algebra is determining whether it is possible to find a 
basis B such that the matrix for T relative to B is diagonal. The solution of this problem 
is discussed in Chapter 7. This section lays a foundation for solving the problem. You 
will see how the matrices for a linear transformation relative to two different bases 
are related. In this section, A, A’, P, and P~! represent the four square matrices listed 


below. 
1. Matrix for T relative to B: A 
2. Matrix for T relative to B’: A’ 


(Basis B) a . 
3. Transition matrix from B’ to B: P 
4. Transition matrix from B to B’: Po} 


JÈ 


Note that in Figure 6.4, there are two ways to get from the coordinate matrix [v]; 


PI! to the coordinate matrix [7(v)],-. One way is direct, using the matrix A’ to obtain 


(Basis B’) A'lv]y > [TO] 
The other way is indirect, using the matrices P, A, and P~! to obtain 
PAPI v]p, = [TW] 


Figure 6.4 This implies that A’ = P~'AP. Example 1 demonstrates this relationship. 


EXAMPLE 1 Finding a Matrix for a Linear Transformation 


Find the matrix A’ for T: R? > R?, where T(x,, x2) = (2x, — 2x5, —x, + 3x), relative 
to the basis B’ = {(1, 0), (1, 1}. 


SOLUTION 


The standard matrix for T is A = E 7 Ar 


Furthermore, using the techniques of Section 4.7, the transition matrix from B’ to 
the standard basis B = {(1, 0), (0, 1)} is 


e-o ih 


The inverse of this matrix is the transition matrix from B to B’, 


1 =1 
1 — 
piaja it 


So, the matrix for T relative to B’ is 


ao ee ae a Ea 
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REMARK 


It is instructive to note that the 
rule T(x, y) = (x — 3y, 2x + 4y) 
represents the transformation 
Tin Examples 2 and 3. Verify 
the results of Example 3 by 
showing that v = (1, — 4) and 
T(v) = (7, —14). 
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In Example 1, the basis B is the standard basis for R?. In the next example, both B 
and B’ are nonstandard bases. 


EXAMPLE 2 Finding a Matrix for a Linear Transformation 


Let B = {(—3, 2), (4, —2)} and B’ = {(— 1, 2), (2, —2)} be bases for R?, and let 
=2 7 
A= 
|- 3 j 
be the matrix for T: R? — R? relative to B. Find A’, the matrix of T relative to B’. 


SOLUTION , z j ; 
In Example 5 in Section 4.7, you found that P = f _ and P™! = E J 


So, the matrix of T relative to B’ is 
-1 2|| -2 73 =2 2 1 
I = = = = = 
Paral) See Gee at F 


Figure 6.4 should help you to remember the roles of the matrices A, A’, P, and P~!. 


EXAMPLE 3 Using a Matrix for a Linear Transformation 


For the linear transformation T: R?— R? from Example 2, find [v],, [T(v)],, and 
[T(v)],- for the vector v whose coordinate matrix is [v],, = [-3 —1]". 


SOLUTION 


To find [v],, use the transition matrix P from B’ to B. 


i, Ptvly [2 2] —3]-[27] 


To find [7(v)],, multiply [v]; on the left by the matrix A to obtain 


rosea 2] -2]-|[ 74] 


To find [7(v)],,, multiply [T(v)], on the left by P~! to obtain 


rile = ero al [GI 


or multiply [v]; on the left by A’ to obtain 
os | 2 Alp=s) fe 


LINEAR A Leslie matrix, named after British mathematician Patrick 
ALGEBRA H. Leslie (1900-1974), can be used to find the age and 
growth distributions of a population over time. The entries 
APPLIED in the first row of an n x n Leslie matrix L are the average 
numbers of offspring per member for each of n age 
classes. The entries in subsequent rows are p; in row/ +1, 
column /and 0 elsewhere, where p; is the probability that 
an ith age class member will survive to become an (i + 1)th 
age class member. If x; is the age distribution vector 
for the jth time period, then the age distribution vector 
for the (j + 1)th time period can be found using the linear 
transformation x;,, = Lx;. You will study population growth 
models using Leslie matrices in more detail in Section 7.4. 
Rich Lindie/Shutterstock.com 
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SIMILAR MATRICES 


Two square matrices A and A’ that are related by an equation A’ = P~'!AP are called 
similar matrices, as stated in the next definition. 


Definition of Similar Matrices 


For square matrices A and A’ of order n, A’ is similar to A when there exists an 
invertible matrix P such that A’ = P~!AP. 


If A’ is similar to A, then it is also true that A is similar to A’, as stated in the next 
theorem. So, it makes sense to simply say that A and A’ are similar. 


THEOREM 6.13 Properties of Similar Matrices 


Let A, B, and C be square matrices of order n. Then the properties below are true. 


1. A is similar to A. 
2. If A is similar to B, then B is similar to A. 
3. If A is similar to B and B is similar to C, then A is similar to C. 


PROOF 
The first property follows from the fact that A = /, AI. To prove the second property, 
write 
A = PBP 
PAP! = P(P~!BP)P7! 
PAP! = B 


Q7'AQ = B, where Q = P™!. 
The proof of the third property is left to you. (See Exercise 33.) m 


From the definition of similarity, it follows that any two matrices that represent 
the same linear transformation T: V — V with respect to different bases must be similar. 


EXAMPLE 4 Similar Matrices 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 
a. From Example 1, the matrices 
2 =2 P 3° =2 
a=| i ] and A -|3 J 
S j £: 1 1 
are similar because A’ = P7!AP, where P = 0 R 
b. From Example 2, the matrices 
=2 7 pa 2 1 
a=|73 | and A a ;| 


3. =? 
imilar b A’ = P'AP, where P = : 
are similar because where | 2 A | 
You have seen that the matrix for a linear transformation T: V— V depends on the 
basis used for V. This observation leads naturally to the question: What choice of basis 
will make the matrix for T as simple as possible? Is it always the standard basis? Not 
necessarily, as the next example demonstrates. 
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see A Comparison of Two Matrices 
EXAMPLE 5 for a Linear Transformation 


Let 
1 3 0 
A=]|3 1 0 
0 0 -2 


be the matrix for T: R? > F? relative to the standard basis. Find the matrix for T relative 
to the basis B’ = {(1, 1, 0), (1, — 1, 0), (0, 0, 1)}. 


SOLUTION 


The transition matrix from B’ to the standard basis has columns consisting of the 
vectors in B’, 


1 1 0 
P=|1 -1 0 
0 0 1 


and it follows that 


2 2 0 
PSs =; Ú 
0 1 


So, the matrix for T relative to B’ is 


A’ = P'AP 
l l 
2 2 Ofi 3 ofi 1. 0 

=|> -3 O}f/3 1 ofi -1 o0 
0 0 1} L0 0 =2|/0 0 1 
4 0 0 

=|0 -2 0}. 
0 0 =2 

Note that matrix A’ is diagonal. ui 


Diagonal matrices have many computational advantages over nondiagonal 
matrices. For example, for the diagonal matrix 


d, O ... O 
pal Gwa 
00... 4, 

the kth power of D is 
dk 0... O 
paj? a 
00... d 


Also, a diagonal matrix is its own transpose. Moreover, if all of the main diagonal 
entries of a diagonal matrix are nonzero, then the inverse of the matrix is also a diagonal 
matrix, whose main diagonal entries are the reciprocals of corresponding entries in the 
original matrix. With such computational advantages, it is important to find ways (if 
possible) to choose a basis for V such that the transformation matrix is diagonal, as it 
is in Example 5. You will pursue this problem in the next chapter. 
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6 4 Exercises See CalcChat.com for worked-out solutions to odd-numbered exercises. 


Finding a Matrix for a Linear Transformation In 
Exercises 1-12, find the matrix A’ for T relative to the 
basis B’. 
1. T: R? > R?, T(x, y) = (2x — y,y — x), 
B' = {(1, —2), (0, 3)} 
2. T: R? > R?, T(x, y) = (2x + y, x — 2y), 
B' = {(1, 2), (0, 4)} 
3. T: R >R, T(x, y) = (x + y, 4y), 
B' = {(—4, 1), (1, —1)} 
4. T: R >R, T(x, y) = (x — 2y, 4x), 
B' = {(=2, 1), (—1, 1)} 
5. T: RR—>R?, T(x, y) = (—3x + y, 3x — y), 
B' = {(1, — 1), (1, 5)} 
6. T: RR—>R?, T(x, y) = (5x + 4y, 4x + Sy), 
B' = {(12, — 13), (13, — 12)} 
7. T: RÈ > R3, T(x, y, z) = (x, y, z), 
B' = {(1, 1, 0), (1, 0, 1), (0, 1, 1)} 
8. T: R3 > R3, T(x, y, z) = (0, 0, 0), 
B' = {(1, 1, 0), (1, 0, 1), (0, 1, 1)} 
9. T: È >R, T(x, y,z) = (y + zx+2z,x + y), 
B' = {(5, 0, — 1), (—3, 2, — 1), (4, — 6, 5)} 
10. T: R? > R3, T(x, y, z) = (=x, x — y, y — 2), 
B' = {(0, = 1, 2), (=2. 0, 3), (1, 3, 0)} 
11. T: R SR’, 
T(x, y, z) = (x-y F Dz, 2x yom ge 2y +z), 
B' = {(, 0, 1), (0, 2, 2), (L, 2; 0)} 
12. T: PÈ > R?, 
T(x, y, z) = (x, x + 2y, x + y + 32), 
B' = į(1, — 1, 0), (0, 0, 1), (0, 1, —1)} 


13. Let B = {(1, 3), (—2, —2)} and B’ = {(—12, 0), (—4, 4)} 
be bases for R?, and let 


3 2 
A= 
o al 
be the matrix for T: R? > R? relative to B. 


(a) Find the transition matrix P from B’ to B. 
(b) Use the matrices P and A to find [v]; and [7(v)],, 
where [v],, =[-1 2F. 

(c) Find P~! and A’ (the matrix for T relative to B’). 
(d) Find [T(v)]; two ways. 

14. Repeat Exercise 13 for B= {(1, 1), (—2,3)}, 
B’ = {(1, — 1), (0, 1)}, and [v]; = [1 —3]”. 
(Use matrix A in Exercise 13.) 


15. Let B = {(1, 2), (—1, —1)} and B’ = {(—4, 1), (0, 2)} 
be bases for R?, and let 


asf -il 


be the matrix for T: R? > R? relative to B. 
(a) Find the transition matrix P from B’ to B. 
(b) Use the matrices P and A to find [v]; and [7(v)],, 
where [v]; =[-1 4F. 
(c) Find P~! and A’ (the matrix for T relative to B’). 
(d) Find [7(v)],, two ways. 
16. Repeat Exercise 15 for B= {(1, —1), (—2, 1)}, 
B’ = {(-1, 1), (1, 2)}, and [v],, = [1 —4]”. 
(Use matrix A in Exercise 15.) 


17. Let B = {(1, 1,0), (1,0, 1), (0, 1, 1)} and B’ = {(1, 0, 0), 
(0, 1, 0), (0, 0, 1)} be bases for R?, and let 


3 1 

3 71l -53 

e |e 1 
A= 2 2 2 
1 5 

2 1 2 


be the matrix for T: R? > R? relative to B. 
(a) Find the transition matrix P from B’ to B. 
(b) Use the matrices P and A to find [v]; and [7(v)],, 
where [v],, =[1 0 —1]". 
(c) Find P~! and A’ (the matrix for T relative to B’). 
(d) Find [7(v)],, two ways. 
18. Repeat Exercise 17 for 
B= ({(1, 1, — 1), (1, —1, 1), (— 1, 1, D} 
B' = {(1, 0, 0), (0, 1, 0), (0, 0, 1)}, and 
[vy =[2 1 1F. 
(Use matrix A in Exercise 17.) 


Similar Matrices In Exercises 19-22, use the matrix P 
to show that the matrices A and A’ are similar. 


=f: =i 12 7], fil -2 
9. p=| 7) balan bag | 


20. P= A= a’ =| ae 


0 1 
5 0 0 5 10 0 5 8 0 
21. P=|0 4 O|,A=/8 4 O},A'=]10 4 O 
0 0 3 0 9 6 0 12 6 
1 1 1 5 0 0 5 2 2 
22. P=|0 1 1),A=]0 3 0|}, A’ =/]0 3 2 
0 0 1 0 0 1 0 0 1 
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Diagonal Matrix for a Linear Transformation In 
Exercises 23 and 24, let A be the matrix for T: R? — R? 
relative to the standard basis. Find the diagonal matrix 
A’ for T relative to the basis B’. 


0 2 0 
23. A=|]1 —-1 0], 
0 0 1 
B' = {(—1, 1, 0), (2, 1, 0), (0, 0, 1)} 
3 1 
2 5l -7 
24. A4a=|-4} 2 35l 
1 5 
z3 it 3 
B" =101;1=1) 0, =1,1), (=1;1,1)} 
25. Proof Prove that if A and B are similar matrices, then 


|A| = |B]. 


Is the converse true? 


26. Illustrate the result of Exercise 25 using the matrices 
1 0 0 11 7 10 
A=|0 -2 0|, B= 10 8 10], 
0 0 3 =18 =12-— 17 
=1 1 0 =] =] 2 
P=); 2 1 2|} P=] 0 -1 2i 
1 1 1 1 2 =3 


where B = P~'AP. 


27. Proof Prove that if A and B are similar matrices, then 
there exists a matrix P such that Bk = P~'!A*P. 


Use the result of Exercise 27 to find B4, where 
B = P'AP 


for the matrices 


1 0 —4 -15 
aslo zl B=| 2 al 


B 37 afs 
r=|; ah? =| al 


Determine all n x n matrices that are similar to J,. 


28 


. 


29 


30. Proof Prove that if A is an idempotent matrix and B is 
similar to A, then B is idempotent. (Recall that ann x n 
matrix A is idempotent when A = A?.) 

31. Proof Let A be an n x n matrix such that A? = O. 
Prove that if B is similar to A, then B? = O. 

32. Proof Consider the matrix equation B = P~'AP. 
Prove that if Ax = x, then PBP~!x = x. 

33. Proof Prove Property 3 of Theorem 6.13: For square 
matrices A, B, and C of order n, if A is similar to B and 
B is similar to C, then A is similar to C. 


. 


34. Writing Explain why two similar matrices have the 


same rank. 


. 


35. Proof Prove that if A and B are similar matrices, then 
AT and B’ are similar matrices. 
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36. Proof Prove that if A and B are similar matrices and A 
is nonsingular, then B is also nonsingular and A~! and 
B~! are similar matrices. 


37. Proof LetA = CD, where C and Daren x n matrices 
and C is invertible. Prove that the matrix product DC 
is similar to A. 

38. Proof Let B = P'AP, where A = [a,], P =[p,], 
and B is a diagonal matrix with main diagonal entries 


bii Bazs- . ., bun: Prove that 

âi Ayn » + + Ay || Pi Pii 
n Gap + Gay) | Poe) — p |P2i 
: i P : ii}. 
any an2 Ank ce ann Pri Phi 

fori=1,2,...,n. 


39 


. 


Writing Let B = {V}, V}. . ., v,} be a basis for the 
vector space V, let B’ be the standard basis, and consider 
the identity transformation /: V— V. What can you say 
about the matrix for Z relative to B? relative to B’? when 
the domain has the basis B and the range has the basis B’? 


40. CAPSTONE 

(a) Consider two bases B and B’ for a vector space 
V and the matrix A for the linear transformation 
T: VV relative to B. Explain how to obtain the 


coordinate matrix [7(v)],, from the coordinate 
matrix [v],,, where v is a vector in V. 


(b) Explain how to determine whether two square 
matrices A and A’ of order n are similar. 


True or False? In Exercises 41 and 42, determine 
whether each statement is true or false. If a statement 
is true, give a reason or cite an appropriate statement 
from the text. If a statement is false, provide an example 
that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


41. (a) The matrix for a linear transformation A’ relative to 
the basis B’ is equal to the product P~'AP, where 
P~' is the transition matrix from B to B’, A is the 
matrix for the linear transformation relative to basis 
B, and P is the transition matrix from B’ to B. 


(b) Two matrices that represent the same linear 
transformation T: V— V with respect to different 
bases are not necessarily similar. 


42. (a) The matrix for a linear transformation A relative to 
the basis B is equal to the product PA’P~'!, where P 
is the transition matrix from B’ to B, A’ is the matrix 
for the linear transformation relative to basis B’, and 
P~! is the transition matrix from B to B’. 

(b) The standard basis for R” will always make the 
coordinate matrix for the linear transformation T 
the simplest matrix possible. 
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6.5 Applications of Linear Transformations 


Identify linear transformations defined by reflections, expansions, 
contractions, or shears in R?. 


| Use a linear transformation to rotate a figure in R3. 


>< 


THE GEOMETRY OF LINEAR TRANSFORMATIONS IN R? 


— The first part of this section gives geometric interpretations of linear transformations 
represented by 2 x 2 elementary matrices. After a summary of the various types of 

Lx 2 x 2 elementary matrices are examples that examine each type of matrix in more 
detail. 


Elementary Matrices for Linear Transformations in R2 


Reflection in y-Axis Reflection in x-Axis 


fei 0 
Es) a=] 0 i = 


Reflection in Line y = x 


__ + a 
| 1 0 


Horizontal Expansion (k > 1) Vertical Expansion (k > 1) 
(x, =y) or Contraction (0 < k < 1) or Contraction (0 < k < 1) 


ata =f 


Horizontal Shear Vertical Shear 


fl k _fl o 
afa | al | 
EXAMPLE 1 Reflections in R2 


The transformations below are reflections. These have the effect of mapping a point in 
the xy-plane to its “mirror image” with respect to one of the coordinate axes or the line 
y = x, as shown in Figure 6.5. 


Reflections in R? 


Figure 6.5 


a. Reflection in the y-axis: 
T(x, y) = (=x, y) 


b. Reflection in the x-axis: 
T(x, y) = @ —y) 


eR 


c. Reflection in the line y = x: 
T(x, y) = (y, x) 


i obli a 
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EXAMPLE 2 Expansions and Contractions in R2 


The transformations below are expansions or contractions, depending on the value of 
the positive scalar k. 


a. Horizontal expansions and contractions: 


T(x, y) = (kx, y) 
o l= [5] 
0 lily y 
b. Vertical expansions and contractions: 


T(x, y) = (x, ky) 


s E-k 


Note in the figures below that the distance the point (x, y) moves by a contraction or an 
expansion is proportional to its x- or y-coordinate. For example, under the transformation 
represented by 


T(x, y) = (2x, y) 


the point (1,3) would move one unit to the right, but the point (4, 3) would move 
four units to the right. Under the transformation represented by 


T(x, y) = (x, 3y) 


the point (1, 4) would move two units down, but the point (1, 2) would move one unit 
down. 


(kx,y) sy) (wy) (kx, y) 


Fa 
f 
f 
> X > xX 
Contraction (0 < k < 1) Expansion (k > 1) 
y 
(x, ky) 
Ed (x > y. ) 
> X 
Contraction (0 < k < 1) Expansion (k > 1) | 


Another type of linear transformation in R? corresponding to an elementary matrix 
is a shear, as described in Example 3. 
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EXAMPLE 3 Shears in R? 


The transformations below are shears. 


T(x, y) = (x + ky, y) T(x, y) = (x, y + kx) 


lL] - p + d 


bo ill] 


a. A horizontal shear represented by 


T(x, y) = (x + 2y, y) 


the right. Under this 
points in the upper 
half-plane “shear” to the right by amounts 
proportional to their y-coordinates. Points 
in the lower half-plane “shear” to the left 
by amounts proportional to the absolute 
values of their y-coordinates. Points on the 
x-axis do not move by this transformation. 


is shown at 


D 


x + ky 


transformation, 


man 
a =e 


d 


A vertical shear represented by 
T(x, y) = (x, y + 2x) 


is shown below. Here, points in the right half-plane “shear” upward by amounts 
proportional to their x-coordinates. Points in the left half-plane “shear” downward 
by amounts proportional to the absolute values of their x-coordinates. Points on the 
y-axis do not move. 


LINEAR 
ALGEBRA 
APPLIED 


P 
A 
Lb 
Q 


The use of computer graphics is common in many fields. 
By using graphics software, a designer can “see” an object 
before it is physically created. Linear transformations can 
be useful in computer graphics. To illustrate, consider a 
simplified example. Only 23 points in R? were used to 
generate images of the toy boat shown at the left. Most 
graphics software can use such minimal information to 
generate views of an image from any perspective, as 
well as color, shade, and render as appropriate. Linear 
transformations, specifically those that produce rotations 
in R3, can represent the different views. The remainder of 
this section discusses rotation in R°. 
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x’, yz’) 
e 


1 
1 
1 
1 
1 
1 
1 
1 
1 
1 

£] 


x 


Figure 6.6 


Figure 6.7 
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ROTATION IN R? 


In Example 7 in Section 6.1, you saw how a linear transformation can be used to 
rotate figures in R*. Here you will see how linear transformations can be used to rotate 
figures in R°. 

Say you want to rotate the point (x, y, z) counterclockwise about the z-axis through 
an angle 0, as shown in Figure 6.6. Letting the coordinates of the rotated point be 
(x’, y', z’), you have 


x! cos@ —sin@ O]lx xcos 0 — ysin 0 
y'|}=]sin@ cos O0||y|=]|xsinð + ycosð |. 
g 0 0 ijz z 


Example 4 uses this matrix to rotate a figure in three-dimensional space. 


ESIE Rotation About the z-Axis 


The eight vertices of the rectangular prism 
shown at the right are 


V,(0,0,0)  V;(1, 0, 0) 
V,(1,2,0)  V,(0, 2, 0) 
V;(0,0,3)  V¢(1, 0, 3) 
V,(1,2,3)  Ve(0, 2, 3). 


Find the coordinates of the vertices after the 
prism is rotated counterclockwise about the 
z-axis through (a) 0 = 60°, (b) 0 = 90°, and 


(c) 0 = 120°. 
SOLUTION 
a. The matrix that yields a rotation of 60° is 
cos 60° —sin60° 0 1/2 —./3/2 0 
A =| sin60°  cos60° 0| =| /3/2 1/2 OJ. 


0 0 1 0 0 1 


Multiplying this matrix by the column vectors corresponding to each vertex 
produces the rotated vertices listed below. 


V,'(0, 0, 0) V,'(0.5, 0.87, 0) V;/(— 1.23, 1.87, 0) V,/(— 1.73, 1, 0) 
V3 (0, 0, 3) V’ (0.5, 0.87, 3) V; (— 1.23, 1.87, 3) Vz (— 1.73, 1, 3) 
Figure 6.7(a) shows a graph of the rotated prism. 
b. The matrix that yields a rotation of 90° is 


cos 90° —sin 90° 0 0 -1 0 
A=] sin90° cos 90° O} =] 1 0 0 
0 0 1 0 0 1 
and Figure 6.7(b) shows a graph of the rotated prism. 
c. The matrix that yields a rotation of 120° is 


cos 120° —sin 120° 0 -1/2 -./3/2 0 
A=] sin120° cos120° 0/=|/3/2 -1⁄2 0 
0 0 1 0 0 1 
and Figure 6.7(c) shows a graph of the rotated prism. m 
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REMARK Example 4 uses matrices to perform rotations about the z-axis. Similarly, you can 
use matrices to rotate figures about the x- or y-axis. A summary of all three types of 


To illustrate the right-hand eee: 
rotations is below. 


rule, imagine the thumb of 


your right hand pointing in the Rotation About the x-Axis Rotation About the y-Axis Rotation About the z-Axis 
positive direction of an axis. 


The cupped fingers will point in 1 0 0 cos@ 0 sin@ Cos 0 —sin@ 0 
the direction of counterclockwise 0 cos@ ~sind 0 1 0 sinô  cos@ 0 
rotation. The figure below 0 sin@ cos 0 —sin@ 0 cosé@ 0 0 1 


shows counterclockwise 


rotation about the z-axis. In each case, the rotation is oriented counterclockwise (using the “right-hand rule”) 


relative to the specified axis, as shown below. 


3 z z 
x AE y x y 


Rotation about x-axis Rotation about y-axis Rotation about z-axis 


EXAMPLE 5 Rotation About the x-Axis and y-Axis 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


z 


a. The matrix that yields a rotation of 90° about the x-axis is 


1 0 0 1 0 0 
A=]0 cos90° -—sin90°|=|0 0 —-1). 
0 sin90° cos 90° 0 1 0 
Figure 6.8(a) shows the prism from Example 4 rotated 90° about the x-axis. 


b. The matrix that yields a rotation of 90° about the y-axis is 


cos 90° 0 sin 90° 0 0 1 
A= 0 1 0| = Oo 1 Ot. 
—sin 90° 0 cos 90° -1 0 0 


Figure 6.8(b) shows the prism from Example 4 rotated 90° about the y-axis. 
b. 


Figure 6.8 m 


Rotations about the coordinate axes can be combined to produce any desired view 
Figure 6.9 of a figure. For example, Figure 6.9 shows the prism from Example 4 rotated 90° about 
the y-axis and then 120° about the z-axis. 
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6.5 Exercises 341 


See CalcChat.com for worked-out solutions to odd-numbered exercises. 


1. Let T: R — RF? be a reflection in the x-axis. Find the 
image of each vector. 


(a) (3, 5) (b) (2, — 1) (c) (a, 0) 
(d) (0, b) (e) (~c, d) Œ) (6-2) 


2. Let T: R — R? be a reflection in the y-axis. Find the 
image of each vector. 


(a) (5, 2) (b) (=1,=6) (©) (a, 0) 
(d) (0, b) (e) (c, =d) (f) (£8) 


3. Let T: R? > R? be a reflection in the line y = x. Find the 
image of each vector. 


(a) (0, 1) (b) (—1, 3) (c) (a, 0) 
(d) (0, b) (e) (~c, d) Œ) (f, =8) 

4. Let T: R? — R? be a reflection in the line y = —x. Find 
the image of each vector. 


(a) (—1, 2) (b) (2, 3) (c) (a, 0) 

(d) (0, b) (e) (e, —d) (f) (=f 8) 
5. Let T(1, 0) = (2, 0) and 7(0, 1) = (0, 1). 

(a) Determine T(x, y) for any (x, y). 

(b) Give a geometric description of T. 
6. Let T(1, 0) = (1, 1) and 7(0, 1) = (0, 1). 

(a) Determine 7(x, y) for any (x, y). 

(b) Give a geometric description of T. 


Identifying and Representing a Transformation In 
Exercises 7-14, (a) identify the transformation, and 
(b) graphically represent the transformation for an 
arbitrary vector in R?. 


7. T(x, y) = & y/2) 

9. T(x, y) = (12x, y) 
11. T(x, y) = (x + 3y, y) 
13. T(x, y) = (x, 5x + y) 
14. T(x, y) = (x, 9x + y) 


8. T(x, y) = (x/4, y) 
10. T(x, y) = (x, 3y) 
12. T(x, y) = (x + 4y, y) 


Finding Fixed Points of a Linear Transformation In 
Exercises 15-22, find all fixed points of the linear 
transformation. Recall that the vector v is a fixed point 
of T when T(v) = v. 


15. A reflection in the y-axis 

16. A reflection in the x-axis 

17. A reflection in the line y = x 
18. A reflection in the line y = —x 
19. A vertical contraction 

20. A horizontal expansion 

21. A horizontal shear 

22. A vertical shear 


Sketching an Image of the Unit Square In Exercises 
23-30, sketch the image of the unit square [a square 
with vertices at (0, 0), (1, 0), (1, 1), and (0, 1)] under the 
specified transformation. 


23. T is a reflection in the x-axis. 

24. T is a reflection in the line y = x. 

25. T is the contraction represented by T(x, y) = (x/2, y). 
26. T is the contraction represented by T(x, y) = (x, y/4). 
27. T is the expansion represented by T(x, y) = (x, 3y). 
28. T is the expansion represented by T(x, y) = (5x, y). 
29. T is the shear represented by T(x, y) = (x + 2y, y). 
30. T is the shear represented by T(x, y) = (x, y + 3x). 


Sketching an Image of a Rectangle In Exercises 
31-38, sketch the image of the rectangle with vertices 
at (0,0), (1, 0), (1,2), and (0,2) under the specified 
transformation. 


31. T is a reflection in the y-axis. 

32. T is a reflection in the line y = x. 

33. T is the contraction represented by T(x, y) = (x/3, y). 
34. T is the contraction represented by T(x, y) = (x, y/2). 
35. T is the expansion represented by T(x, y) = (x, 6y). 
36. T is the expansion represented by T(x, y) = (2x, y). 
(x + y,y). 
38. T is the shear represented by T(x, y) = (x, y + 2x). 


37. T is the shear represented by T(x, y) = 


Sketching an Image of a Figure In Exercises 
39-44, sketch each of the images under the specified 
transformation. 


(a) y (b) 


39. T is a reflection in the x-axis. 


40. T is a reflection in the line y = x. 


(x + y, y). 
42. T is the shear represented by T(x, y) = (x, x + y). 


41. T is the shear represented by T(x, y) = 


43. T is the expansion and contraction represented by 


1 
T(x, y) = (2x, Sy). 
44. T is the expansion and contraction represented by 


T(x, y) = Gx, 2y). 
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Giving a Geometric Description In Exercises 45-50, 
give a geometric description of the linear transformation 
defined by the elementary matrix. 


2 0 1 0 
45. a=|¢ | 46. a=|) A 


1 5 
mash $ 


1 0 
wa-[ 9 


Giving a Geometric Description In Exercises 51 
and 52, give a geometric description of the linear 
transformation defined by the matrix product. 


2 0 2 O}} 1 0 
baal Glo all i 
0 3 0 1}) 1 0 
sasi aab olla a 
53. The linear transformation defined by a diagonal matrix 
with positive main diagonal elements is called a 
magnification. Find the images of (1, 0), (0, 1), and 


(2, 2) under the linear transformation defined by A and 
graphically interpret your result. 


aso 5] 


54. CAPSTONE Describe the transformation 
defined by each matrix. Assume k and @ are 
positive scalars. 


o| 
ol 


—sin 0 


1 
i) j) |0 cosé 
0 sin cos @ 


cos@ 0 sin@ cos@ —sinð 0 
(k) 0 1 0 (1) | sin @ cos 0 
—sin@ 0 cos 0 0 1 


Finding a Matrix to Produce a Rotation In Exercises 
55-58, find the matrix that produces the rotation. 


55. 30° about the z-axis 56. 60° about the x-axis 
57. 120° about the x-axis 58. 60° about the y-axis 


Finding the Image of a Vector In Exercises 59-62, 
find the image of the vector (1, 1, 1) for the rotation. 


59. 30° about the z-axis 60. 60° about the x-axis 
61. 120° about the x-axis 62. 60° about the y-axis 


Determining a Rotation In 
Exercises 63-68, determine 
which single counterclockwise 
rotation about the x-, y-, or 
z-axis produces the rotated 
tetrahedron. The figure at the 
right shows the tetrahedron 
before rotation. x 


63. 64. 


z z 
x ke y ¥ Ae y 
65. z 66. 4 


A 


67. z 68. 


Determining a Matrix to Produce a Pair of 
Rotations In Exercises 69-72, determine the matrix 
that produces the pair of rotations. Then find the image 
of the vector (1, 1, 1) under these rotations. 


69. 90° about the x-axis and then 90° about the y-axis 
70. 30° about the z-axis and then 60° about the y-axis 
71. 45° about the z-axis and then 135° about the x-axis 
72. 120° about the x-axis and then 135° about the z-axis 
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343 
i 7 [m] pi m] 
6 Review Exe rcises See CalcChat.com for worked-out solutions to odd-numbered exercises. A | 


Finding an Image and a Preimage In Exercises 1—6, 
find (a) the image of v and (b) the preimage of w for the 
linear transformation. 


1. T: RR—R?, T(v,, v2) = (vi vı + 2v3), v = (2, — 3), 
w = (4, 12) 

2. T: RR—>R?, T(v,, vo) = (vi + v5, 2v3), v = (4, — 1), 
w = (8,4) 

3. T: RÈ > R3, T(v,, va, v3) = (0, vi + va, v3 + V3), 
v = (-3, 2,5), w = (0, 2, 5) 

4. T: R? —>R?, T(v,, Va, v3) = (vi + Va, Va + v3, V3), 
v = (-2,1,2),w = (0,1,2) 

5. T: R2 SR’, T(v,, v2) = wi + va» vi — 
v = (2, —3), w = (1, —3, 4) 

6. T: RR—>R, Tvi, v2) = (2v; 


va, 2v; + 3v3), 


v), v = (2, -3),w = 4 


Linear Transformations and Standard Matrices In 
Exercises 7-18, determine whether the function is a 
linear transformation. If it is, find its standard matrix A. 


7. T: R> R2, T(x) = (x, x + 2) 
8. T: R7 SR, T(x), %5) = (x, + x) 
9. T: R> R?, T(x, x) = (x, + 2x5, =x; — x) 
10. T: R? > R?, T(x, x») = (x, + 3, x) 
11. T: R? > R?, T(x, y) = (x — 2y, 2y — x) 
12. T: R > R?, T(x, y) = (x + y, y) 
13. T: R SR, T(x, y) = +hyt+k,h# Oork #0 
(translation in R?) 


14. T: R? > R?, T(x, y) = (|x|, ly) 

15. T: RÈ > R3, T(x), Xz X3) = (x1 + Xz 2, X3 — x1) 

16. T: R? — RÈ, T(x, X2, x3) = Oy Z Kan X2 = X3, X3 = Hy) 
17. T: R3 > R3, T(x, y, z) = (z, y, x) 

18. T: R? —>R?, T(x, y, z) = (x, 0, —y) 


? 


19. Let T be a linear transformation from R? into R? such 
that 7(2, 0) = (1, 1) and 7(0, 3) = (3, 3). Find T(1, 1) 
and 7(0, 1). 

20. Let T be a linear transformation from R? into R such that 
T(1, 1, 1) = 1, TQ, 1, 0) = 2, and 7(1, 0, 0) = 3. Find 
TO 1, 1). 

21. Let T be a linear transformation from R? into R? such 
that 7(4, —2) = (2, —2) and 7(3,3) = (—3, 3). Find 
T(-7, 2). 

22. Let T be a linear transformation from R? into R? such 
that 7(1, —1) = (2,—3) and 7(0,2) = (0,8). Find 
T(2, 4). 


Linear Transformation Given by a Matrix In Exercises 
23-28, define the linear transformation T: R” > R” 
by T(v) = Av. Use the matrix A to (a) determine the 
dimensions of R” and R”, (b) find the image of v, and 
(c) find the preimage of w. 


al ; shy = G1. Dew = 8.5) 
a. a=] ; “ify = 6.22.0= 62 
l1 1 1 
25 ar 1 1|, v= (2,1,—5),w = (6, 4, 2) 
0 0 1 
2 j 
%. a =| |= eaw 
0 1 
4 0 
27.A=|0  5ļ,v= (2,2), w = (4, —5,0) 
f 1 
=i Ü 
28. A=] 0 1\|,v=@G,5),w= (5,2, -1) 
-1 -3 


29. Use the standard matrix for counterclockwise rotation 
in R? to rotate the triangle with vertices (3, 5), (5, 3), 
and (3, 0) counterclockwise 90° about the origin. Graph 
the triangles. 


30. Rotate the triangle in Exercise 29 counterclockwise 90° 
about the point (5, 3). Graph the triangles. 


Finding the Kernel and Range In Exercises 31-34, 
find (a) ker(T) and (b) range(T). 
31. T: Rt—> R?, 

T(w, x, y, z) = (2w + 4x + 6y + 5z, 

—w — 2x + 2y, 8y + 4z) 

32. T: RÈ => R?, T(x, y, z) = (x + 2y, y + 2z,z + 2x) 
33. T: R? > R?, T(x, y, z) = (x, y, z + 3y) 
34. T: R —>R?, T(x, y, z) = (x + y,y + zx — z) 
Finding the Kernel, Nullity, Range, and Rank In 
Exercises 35-38, define the linear transformation T by 
T(v) = Av. Find (a) ker(T), (b) nullity(T), (c) range(T), 
and (d) rank(T). 


1 2 =] 2 
35. A=|-1 0 36 A=| 0 -1 
1 1 =2 2 
2 3 | “= 
37. A=]1 1 0 38. A=] 1 2 
0 =3 0 1 0 
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39. For T: R — F? and nullity(T) = 2, find rank(7). 
40. For T: P;— P, and nullity(T) = 4, find rank(7). 
41. For T: P}— R? and rank(7) = 3, find nullity(7). 
42. For T: M,,—M,,, and rank(7) = 5, find nullity(7). 


Finding a Power of a Standard Matrix In Exercises 
43-46, find the specified power of A, the standard 
matrix for T. 


43. T: R? > R’, reflection in the xy-plane. Find A’. 
44, T: R? > R?, projection onto the xy-plane. Find A”. 


45. T: R?—R?, counterclockwise rotation through the 
angle @. Find A?. 


46. Calculus T: P;—P;, differential operator D,. Find A?. 


Finding Standard Matrices for Compositions In 
Exercises 47 and 48, find the standard matrices for 
T=T,°T,andT' = T; ° T} 
47. T,: R> R, T,(x, y) = (x, x + y, y) 

T,: R? > RÈ, T,(x, y, z) = (0, y) 
48. Ti: R>R?, T,(x) = (x, 4x) 

T,: R? > R, T,(x, y) = (y + 3x) 


Finding the Inverse of a Linear Transformation 
In Exercises 49-52, determine whether the linear 
transformation is invertible. If it is, find its inverse. 


49. T: R? > R?, T(x, y) = (0, y) 
50. T: R > R’, 
T(x, y) = (x cos 0 — y sin 0, x sin 0 + y cos 0) 
51. T: RR—>R?, T(x, y) = (x, —y) 
52. T: RÈ > R?, T(x, y, z) = (x + y, y — 2) 
One-to-One, Onto, and Invertible Transformations 
In Exercises 53-56, determine whether the linear 


transformation represented by the matrix A is 
(a) one-to-one, (b) onto, and (c) invertible. 


1 i 
ss. a= |6 "| 54. A = k 
0 1 


0- = 
4 0 7 
s5. a = |o y ‘| 56. A =|5 5 1 
0 0 2 


Finding the Image Two Ways In Exercises 57 and 58, 
find 7(v) by using (a) the standard matrix and (b) the 
matrix relative to B and B’. 


57. T: R> R?, 

T(x, y) = (=x, y, x + y), v = (0, 1), 

B = {(1, 1), (1, —1)}, B’ = {(0, 1, 0), (0, 0, 1), (1, 0, 0)} 
58. T: R2 > R2, 

T(x, y) = (2y, 0), v = (1, 3), 

B = {(2, 1), (— 1, 0}, B’ ={(-1,0), (2, 2)} 


Finding a Matrix for a Linear Transformation In 
Exercises 59 and 60, find the matrix A’ for T relative to 
the basis B’. 


59. T: R? SR’, T(x, y) = (x — 3y, y — x), 
B' = {(1, —1), (1, 1h 

60. T: RÈ > R°, T(x, y, z) = (x + 3y, 3x + y, —2z), 
B' = {(1, 1, 0), (1, — 1, 0), (0, 0, 1)} 


Similar Matrices In Exercises 61 and 62, use the 
matrix P to show that the matrices A and A’ are similar. 


2 -1 6 -3].,_f 1 -9 
sista T as oa -|_1 I 

12 0 101 2 0 0 
62. P=|0 1 -1],A=|-1 3 1],47=|0 1 0 

10 0 00 2 00 3 


63. Define T: R? — R? by T(v) = proj,,v,whereu = (0, 1, 2). 
(a) Find A, the standard matrix for T. 


(b) Let S be the linear transformation represented 
by J — A. Show that S is of the form 


S(v) = projw, V + projy.V 
where w, and w, are fixed vectors in R°. 
(c) Show that the kernel of T is equal to the range of S. 
64. Define T: R? > R? by T(v) = proj,v, where u = (4, 3). 
(a) Find A, the standard matrix for T, and show that 
A=A, 
(b) Show that (I — A)? = I — A. 
(c) Find Av and (J — A)v for v = (5, 0). 
(d) Sketch the graphs of u, v, Av, and (J — A)v. 


65. Let S and T be linear transformations from V into W. 
Show that S + T and kT are both linear transformations, 
where (S + T)(v) = S(v) + T(v) and (kT)(v) = kT(v). 

66. Proof Let T: R?— R? such that T(v) = Av + b, where 
A is a 2 x 2 matrix. (Such a transformation is called 
an affine transformation.) Prove that T is a linear 
transformation if and only if b = 0. 


Sum of Two Linear Transformations In Exercises 
67 and 68, consider the sum S + T of two linear 
transformations S: VW and T: V— W, defined as 
(S + T)(v) = S(v) + T(v). 
67. Proof Prove that rank(S + T) < rank(S) + rank(7). 
68. Give an example for each. 

(a) Rank(S + T) = rank(S) + rank(T) 

(b) Rank(S + T) < rank($) + rank(T) 
69. Proof Let T: P} —R such that 

Tay + ax + a xX? + ax?) = ag + a, + ay t+ ay. 

(a) Prove that T is a linear transformation. 

(b) Find the rank and nullity of T. 

(c) Find a basis for the kernel of T. 
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70. Proof Let 
T:V=>U and S: U—>W 
be linear transformations. 

(a) Prove that ker(T) is contained in ker(S • T). 
(b) Prove that if S - T is onto, then so is S. 

71. Let V be an inner product space. For a fixed nonzero 
vector V, in V, let T: V— R be the linear transformation 
T(v) = (v, Vv). Find the kernel, range, rank, and nullity 
of T. 

72. Calculus Let B = {1, x, sin x, cos x} be a basis for a 
subspace W of the space of continuous functions, and 
let D, be the differential operator on W. Find the matrix 


for D, relative to the basis B. Find the range and kernel 
of D- 


73. Writing Are the vector spaces R*, M>, and M,, 
exactly the same? Describe their similarities and 
differences. 


74. Calculus Define T: P} > P} by 


T(p) = p(x) + p'(x). 
Find the rank and nullity of T. 


Identifying and Representing a Transformation In 
Exercises 75-80, (a) identify the transformation, and 
(b) graphically represent the transformation for an 
arbitrary vector in R?. 
75. T(x, y) = (x, 2y) 

77. T(x, y) = (x, y + 3x) 
79. T(x, y) = (x + 5y, y) 


76. T(x, y) = (x + y, y) 

78. T(x, y) = (5x, y) 

80. T(x, y) = (x, y+ 3x) 
Sketching an Image of a Triangle In Exercises 81-84, 


sketch the image of the triangle with vertices (0, 0), (1, 0), 
and (0, 1) under the specified transformation. 


81. T is a reflection in the x-axis. 

82. T is the expansion represented by T(x, y) = (2x, y). 
83. T is the shear represented by T(x, y) = (x + 3y, y). 
84. T is the shear represented by T(x, y) = (x, y + 2x). 


Giving a Geometric Description In Exercises 85 
and 86, give a geometric description of the linear 
transformation defined by the matrix product. 


s[i ola Lo illo 
s[e | Ea 


Finding a Matrix to Produce a Rotation In Exercises 
87-90, find the matrix that produces the rotation. Then 
find the image of the vector (1, — 1, 1). 


87. 45° about the z-axis 88. 90° about the x-axis 
89. 60° about the x-axis 90. 30° about the y-axis 


Review Exercises 345 


Determining a Matrix to Produce a Pair of Rotations 
In Exercises 91-94, determine the matrix that produces 
the pair of rotations. 


91. 60° about the x-axis and then 30° about the z-axis 
92. 120° about the y-axis and then 45° about the z-axis 
93. 30° about the y-axis and then 45° about the z-axis 
94. 60° about the x-axis and then 60° about the z-axis 


Finding an Image of a Unit Cube In Exercises 95-98, 
find the image of the unit cube with vertices (0, 0, 0), 
(1, 0, 0), (1, 1, 0), (0, 1, 0), (0, 0, 1), (1, 0, 1), (1, 1, 1), and 
(0, 1, 1) when it rotates through the given angle. 

95. 45° about the z-axis 96. 90° about the x-axis 


97. 30° about the x-axis 98. 120° about the z-axis 


True or False? In Exercises 99-102, determine whether 
each statement is true or false. If a statement is true, give 
a reason or cite an appropriate statement from the text. 
If a statement is false, provide an example that shows the 
statement is not true in all cases or cite an appropriate 
statement from the text. 


99. (a) Reflections that map a point in the xy-plane to 
its mirror image across the line y = x are linear 
transformations that are defined by the matrix 


(b) Horizontal expansions or contractions are linear 
transformations that are defined by the matrix 


loaf 


100. (a) Reflections that map a point in the xy-plane 
to its mirror image across the x-axis are linear 
transformations that are defined by the matrix 


lo if 


(b) Vertical expansions or contractions are linear 
transformations that are defined by the matrix 


lo ih 


101. (a) In calculus, any linear function is also a linear 
transformation from R? to R?. 


(b) A linear transformation is onto if and only if, for 
all u and v in V, T(u) = T(v) implies u = v. 

(c) For ease of computation, it is best to choose a basis 
for V such that the transformation matrix is diagonal. 


102. (a) For polynomials, the differential operator D, is a 

linear transformation from P, into P,,_ ;. 

(b) The set of all vectors v in V that satisfy T(v) = v 
is the kernel of 7. 


(c) The standard matrix A of the composition of 
two linear transformations T(v) = T,(T,(v)) is 
the product of the standard matrix for T, and the 
standard matrix for T). 
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6 Projects 


Let € be the line ax + by = 0 in R?. The linear transformation L: R? > R? that 
maps a point (x, y) to its mirror image with respect to € is called the reflection 
in €. (See Figure 6.10.) The goal of these two projects is to find the matrix for this 
reflection relative to the standard basis. 


1 Reflections in R2 (I) 


In this project, you will use transition matrices to determine the standard matrix for 
Figure 6.10 the reflection L in the line ax + by = 0. 


1. Find the standard matrix for L for the line x = 0. 
2. Find the standard matrix for L for the line y = 0. 


a 


Find the standard matrix for L for the line x — y = 0. 


A 


Consider the line € represented by x — 2y = 0. Find a vector v parallel to € and 
another vector w orthogonal to €. Determine the matrix A for the reflection in € 
relative to the ordered basis {v, w}. Finally, use the appropriate transition matrix 
to find the matrix for the reflection relative to the standard basis. Use this matrix 
to find the images of the points (2, 1), (— 1, 2), and (5, 0). 


5. Consider the general line € represented by ax + by = 0. Find a vector v 
parallel to € and another vector w orthogonal to €. Determine the matrix A 
for the reflection in € relative to the ordered basis {v, w}. Finally, use the 
appropriate transition matrix to find the matrix for the reflection relative to the 
standard basis. 


6. Find the standard matrix for the reflection in the line 3x + 4y = 0. Use this 
matrix to find the images of the points (3, 4), (— 4, 3), and (0, 5). 


2 Reflections in R? (Il) 


In this project, you will use projections to determine 
the standard matrix for the reflection L in the line 


u i 
ax + by = 0. Recall that the projection of the vector u 
onto the vector v (shown at the right) is l 
; Vv projyu v 
roju = v. 
proj, TA 


1. Find the standard matrix for the projection onto the y-axis. That is, find the 
standard matrix for proj,u when v = (0, 1). 


2. Find the standard matrix for the projection onto the x-axis. 


3. Consider the line € represented by x — 2y = 0. Find a vector v parallel to € and 
another vector w orthogonal to €. Determine the matrix A for the projection onto 
€ relative to the ordered basis {v, w}. Finally, use the appropriate transition matrix 
to find the matrix for the projection relative to the standard basis. Use this matrix 
to find proj,u for u = (2, 1), u = (—1, 2), and u = (5, 0). 

4. Consider the general line € represented by ax + by = 0. Find a vector v 
parallel to € and another vector w orthogonal to €. Determine the matrix A 
for the projection onto € relative to the ordered basis {v, w}. Finally, use the 
appropriate transition matrix to find the matrix for the projection relative to the 
standard basis. 


5. Use Figure 6.11 to show that proj,u = 5(u + L(u)), where L is the reflection in 
the line £. Solve this equation for L and compare your answer with the formula 


Figure 611 from the first project. 


EDHAR/Shutterstock.com 
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7.1 Eigenvalues and Eigenvectors 


REMARK 


Only eigenvectors of real 
eigenvalues are presented in 
this chapter. 


Verify eigenvalues and corresponding eigenvectors. 
Find eigenvalues and corresponding eigenspaces. 


Use the characteristic equation to find eigenvalues and eigenvectors, 
and find the eigenvalues and eigenvectors of a triangular matrix. 


| Find the eigenvalues and eigenvectors of a linear transformation. 


THE EIGENVALUE PROBLEM 


This section presents one of the most important problems in linear algebra, the eigenvalue 
problem. Its central question is “when A is ann x n matrix, do nonzero vectors x in R” exist 
such that Ax is a scalar multiple of x?” The scalar, denoted by the Greek letter lambda (A), 
is called an eigenvalue of the matrix A, and the nonzero vector x is called an eigenvector 
of A corresponding to À. The origins of the terms eigenvalue and eigenvector are from the 
German word Eigenwert, meaning “proper value.” So, you have 


Ax = Xx. 


Eigenvalues and eigenvectors have many important applications, many of which are 
discussed throughout this chapter. For now, you will consider a geometric interpretation 
of the problem in R?. If À is an eigenvalue of a matrix A and x is an eigenvector of A 
corresponding to A, then multiplication of x by the matrix A produces a vector Àx that 
is parallel to x, as shown below. 


Ax 


Ax 


Ax =Ax, A>0 Ax= Ax, A<0 


Definitions of Eigenvalue and Eigenvector 


Let A be an n X n matrix. The scalar A is an eigenvalue of A when there is 
a nonzero vector x such that Ax = Ax. The vector x is an eigenvector of A 
corresponding to A. 


Note that an eigenvector cannot be zero. Allowing x to be the zero vector would 
render the definition meaningless, because AO = AO is true for all real values of À. 
An eigenvalue of A = 0, however, is possible. (See Example 2.) 
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DISCOVERY 


Í. in Example 2, A, = 1 is 
an eigenvalue of the 
matrix A. Calculate 
the determinant of the 
matrix A,/ — A, where 
lis the 3 x 3 identity 
matrix. 


Repeat for the other 
eigenvalue, A, = 0. 


In general, when J is 
an eigenvalue of the 
matrix A, what is the 
value of |A/ — A|? 
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A matrix can have more than one eigenvalue, as demonstrated in Examples 1 
and 2. 


EXAMPLE 1 Verifying Eigenvectors and Eigenvalues 


For the matrix 


aso i] 


verify that x, = (1,0) is an eigenvector of A corresponding to the eigenvalue 
A, = 2, and that x, = (0, 1) is an eigenvector of A corresponding to the eigenvalue 
A, = =l. 


SOLUTION 
Multiplying x, on the left by A produces 


2 ojj 1 2 1 
as=[ illo] = lo] = Aol 


So, x, = (1,0) is an eigenvector of A corresponding to the eigenvalue A, = 2. 
Similarly, multiplying x, on the left by A produces 


ssla a= l-k] 


So, x, = (0, 1) is an eigenvector of A corresponding to the eigenvalue 1, = — 1. m 


EXAMPLE 2 Verifying Eigenvectors and Eigenvalues 


For the matrix 


I =2 1 
A=]J|0 0 0 
0 1 1 


verify that 
x, = (-3,-1,1) and x, = (1,0,0) 


are eigenvectors of A and find their corresponding eigenvalues. 


SOLUTION 
Multiplying x, on the left by A produces 
1 =2 li -3 0 =3 
Ax, =| 0 0 O}/ -—1] =|0] =O, -1). 
0 1 1 1 0 1 


So, x, = (—3, — 1, 1) is an eigenvector of A corresponding to the eigenvalue A, = 0. 
Similarly, multiplying x, on the left by A produces 


It =2 1} 1 1 Í 
Ax, =|0 0 0|}0) =]0} = 10}. 
0 1 1 |, 0 0 0 
So, x, = (1, 0, 0) is an eigenvector of A corresponding to the eigenvalue A, = 1. m 
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(=x, y) (0, y) (0, y) (x, y) 


(x, 0) 


a x 


A reflects vectors 
in the y-axis. 


Figure 7.1 


REMARK 


The geometric solution in 
Example 3 is not typical of the 
general eigenvalue problem. 
A more general approach 
follows. 


EIGENSPACES 


Although Examples 1 and 2 list only one eigenvector for each eigenvalue, each of the 
four eigenvalues in Examples 1 and 2 has infinitely many eigenvectors. For instance, 
in Example 1, the vectors (2, 0) and (—3, 0) are eigenvectors of A corresponding to the 
eigenvalue 2. In fact, if A is an n x n matrix with an eigenvalue À and a corresponding 
eigenvector x, then every nonzero scalar multiple of x is also an eigenvector of A. 
To see this, let c be a nonzero scalar, which then produces 


A(cx) = c(Ax) = c(Ax) = A(ex). 


It is also true that if x, and x, are eigenvectors corresponding to the same eigenvalue À, 
then their sum is also an eigenvector corresponding to A, because 


A(x, + x,) = Ax, + Ax, = Ax, + Ax, = A(x, + x,). 


In other words, the set of all eigenvectors of an eigenvalue A, together with the zero 
vector, is a subspace of R”. This special subspace of R” is called the eigenspace of À. 


THEOREM 7.1 Ejigenvectors of 1 Form a Subspace 


If A is an n x n matrix with an eigenvalue À, then the set of all eigenvectors 
of A, together with the zero vector 


{x: x is an eigenvector of A} U {0} 


is a subspace of R”. This subspace is the eigenspace of À. 


Determining the eigenvalues and corresponding eigenspaces of a matrix can 
involve algebraic manipulation. Occasionally, however, it is possible to find eigenvalues 
and eigenspaces by inspection, as demonstrated in Example 3. 


EXAMPLE 3 Finding Eigenspaces in R? Geometrically 


=l 
Find the eigenvalues and corresponding eigenspaces of A = | 0 i 


SOLUTION 


Geometrically, multiplying a vector (x, y) in R? by the matrix A corresponds to a 
reflection in the y-axis. That is, if v = (x, y), then 


=] 0 }| x =y 
Av = = ; 
. | 0 Ls] | 4 
Figure 7.1 illustrates that the only vectors reflected onto scalar multiples of themselves 


are those lying on either the x-axis or the y-axis. 


For a vector on the x-axis For a vector on the y-axis 


Fo alalla Fo lill] 


Eigenvalue is 1, = 1. 


Eigenvalue isA, = —1. 


So, the eigenvectors corresponding to 1, = — 1 are the nonzero vectors on the x-axis, 
and the eigenvectors corresponding to A, = 1 are the nonzero vectors on the y-axis. 
This implies that the eigenspace corresponding to 1, = — 1 is the x-axis, and that the 
eigenspace corresponding to A, = 1 is the y-axis. | 
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REMARK 


The characteristic polynomial 
of Ais of degree n, so A 

can have at most n distinct 
eigenvalues. The Fundamental 
Theorem of Algebra states 
that an nth-degree polynomial 
has precisely n roots. These n 
roots, however, include both 
repeated and complex roots. In 
this chapter, you will focus on 
the real roots of characteristic 
polynomials—that is, real 
eigenvalues. 


REMARK 
Check that the eigenvalues and 
eigenvectors in this example 
satisfy the equation Ax = A;x. 
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FINDING EIGENVALUES AND EIGENVECTORS 


To find the eigenvalues and eigenvectors of an n x n matrix A, let J be the n x n 
identity matrix. Rewriting Ax = Ax as AJx = Ax and rearranging gives (AJ — A)x = 0. 
This homogeneous system of equations has nonzero solutions if and only if the 
coefficient matrix (AJ — A) is not invertible—that is, if and only if its determinant is 
zero. The next theorem formally states this. 


THEOREM 7.2 Eigenvalues and Eigenvectors of a Matrix 


Let A be ann x n matrix. 


1. An eigenvalue of A is a scalar A such that det(AJ — A) = 0. 
2. The eigenvectors of A corresponding to À are the nonzero solutions of 
QAI — A)x = 0. 


The equation det(AJ — A) = 0 is the characteristic equation of A. Moreover, 
when expanded to polynomial form, the polynomial 


[Ad = A| =A” eee, AT! a 8 H Pe GAP co 


is the characteristic polynomial of A. So, the eigenvalues of an n x n matrix A 
correspond to the roots of the characteristic polynomial of A. 


EXAMPLE 4 Finding Eigenvalues and Eigenvectors 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


2 =12 
Find the eigenvalues and corresponding eigenvectors of A = | | 


1 =5 
SOLUTION 
The characteristic polynomial of A is 
A-2 12 
-A| = =)27+31-104+ 12=(At+ + 2), 

JAZ — A| | 4 re A 31-10 + 12 =(A + 1) + 2) 
So, the characteristic equation is (A + 1)(A + 2) = 0, which gives A, = —1 and 
A, = —2 as the eigenvalues of A. To find the corresponding eigenvectors, solve 
the homogeneous linear system represented by (AJ — A)x = 0 twice: first for 
A =A, = —1,and then for A = A, = —2. For A, = —1, the coefficient matrix is 


corman[ i asl 


1 4 
which row reduces to | 0 a showing that x, — 4x, = 0. Letting x, = t, you can 


conclude that every eigenvector of 1, is of the form 


EJ e 


For A, = —2, you have 


caras [PTT SILT] > lo ~ol 


Letting x, = t, you can conclude that every eigenvector of À, is of the form 


E-P E e a 
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The homogeneous systems that arise when you are finding eigenvectors will 
always row reduce to a matrix having at least one row of zeros, because the systems 
must have nontrivial solutions. A summary of the steps used to find the eigenvalues and 
corresponding eigenvectors of a matrix is below. 


Finding Eigenvalues and Eigenvectors 


Let A be ann x n matrix. 


. Form the characteristic equation |AJ — A| = 0. It will be a polynomial 
equation of degree n in the variable À. 

. Find the real roots of the characteristic equation. These are the eigenvalues 
of A. 

. For each eigenvalue 1,, find the eigenvectors corresponding to A, by solving 
the homogeneous system (A,J — A)x = 0. This can require row reducing an 
n x n matrix. The reduced row-echelon form must have at least one row 
of zeros. 


Finding the eigenvalues of an n x n matrix can involve the factorization of an 
nth-degree polynomial. Once you have found an eigenvalue, you can find the 
corresponding eigenvectors by any appropriate method, such as Gauss-Jordan elimination. 


EXAMPLE 5 Finding Eigenvalues and Eigenvectors 


Find the eigenvalues and corresponding eigenvectors of 


2 1 0 
A=|0 2 0}. 
0 0 2 


What is the dimension of the eigenspace of each eigenvalue? 


SOLUTION 
The characteristic polynomial of A is 
A-2 =1 0 
ar-Al=| 0 A-2 0 
0 0 A-2 
= (A — 2}. 


So, the characteristic equation is (A — 2)? = 0, and the only eigenvalue is A = 2. 
To find the eigenvectors of A = 2, solve the homogeneous linear system represented 
by (2I — A)x = 0. 


0 =] 0 
2I-A=|0 0 0 
0 0 0 


This implies that x, = 0. Using the parameters s = x, and £ = x}, you can conclude that 
the eigenvectors of A = 2 are of the form 


x, Ss il 0 
x = |x,] =]0] = s} 0} + 2/0], sand ¢ not both zero. 
X3 t 0 1 


A = 2 has two linearly independent eigenvectors, so the dimension of its eigenspace 


is 2. | 
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TECHNOLOGY 


Use a graphing utility or a 
software program to find the 
eigenvalues and eigenvectors 
in Example 6. When finding the 
eigenvectors, the technology 
you use may produce a matrix 
in which the columns are scalar 
multiples of the eigenvectors 
you would obtain by hand 
calculations. The Technology 
Guide at CengageBrain.com 
can help you use technology 
to find eigenvalues and 
eigenvectors. 
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If an eigenvalue A, occurs as a multiple root (k times) of the characteristic 
polynomial, then 1, has multiplicity k. This implies that (A — A,)* is a factor of the 
characteristic polynomial and (A — A,)**! is not a factor of the characteristic polynomial. 
For instance, in Example 5, the eigenvalue A = 2 has a multiplicity of 3. 

Also note that in Example 5, the dimension of the eigenspace of A = 2 is 2. 
In general, the multiplicity of an eigenvalue is greater than or equal to the dimension of 
its eigenspace. (In Exercise 63, you are asked to prove this.) 


EXAMPLE 6 Finding Eigenvalues and Eigenvectors 


Find the eigenvalues of 


1 0 0 0 


0 1 5 —10 
a= i 0 2 0 
1 0 0 3 


and find a basis for each of the corresponding eigenspaces. 


SOLUTION 
The characteristic polynomial of A is 
A-1 0 0 0 
0 A-I1 =5 10 
a 9 4-2 0 
= 0 0 A-3 
=(=- 1PA = 2) = 3). 


So, the characteristic equation is (A — 1)?(A — 2)(A — 3) = 0 and the eigenvalues are 
A, = 1,A, = 2, and A, = 3. (Note that 1, = 1 has a multiplicity of 2.) 
You can find a basis for the eigenspace of 1, = 1 as shown below. 


0 0 0 0 1 0 0 2 
0 0 -5 10 3 0 0 1 =2 
See = g =i 0 0 0 0 0 
=] 0 0 =2 0 0 0 0 
Letting s = x, and t = x, produces 
x, Os — 2t 0 =2 
X s + Of 1 0 
Nae ise ae] to | a2 
X4 Os + t 0 1 
So, a basis for the eigenspace corresponding to A, = 1 is 


B = {(0, 1, 0, 0), (— 2, 0, 2, 1)}. Basis for A, = 1 
For À, = 2 and A, = 3, use the same procedure to obtain the eigenspace bases 
B, = {(0, 5, 1, 0)} 


B, = {(0, —5, 0, 1)}. 


Basis for A, = 2 
Basis for A, = 3 Lal 


Finding eigenvalues and eigenvectors of matrices of order n = 4 can be tedious. 
Moreover, using the procedure shown in Example 6 on a computer can introduce 
roundoff errors. Consequently, it can be more efficient to use numerical methods of 
approximating eigenvalues. One of these numerical methods appears in Section 10.3. 
Other methods appear in texts on advanced linear algebra and numerical analysis. 


Copyright 2017 Cengage Learning. All Rights Reserved. May not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eBook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage Learning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


354 


Chapter 7 Eigenvalues and Eigenvectors 


The next theorem states that the eigenvalues of ann x n triangular matrix are simply 
the entries on the main diagonal. The proof of this theorem follows from the fact that 
the determinant of a triangular matrix is the product of its main diagonal entries. 


THEOREM 7.3 Eigenvalues of Triangular Matrices 


If A is ann xX n triangular matrix, then its eigenvalues are the entries on its main 
diagonal. 


Finding Eigenvalues of Triangular 
EXAMPLE 7 and Diagonal Matrices 


Find the eigenvalues of each matrix. 


2 0 0 
a A=|-1 1 0 
5 3-3 
-1 0 0 0 (0) 
0 2 0 0 0 
b. A= 0 0 0 0 0 
0 0 0 —4 0 
0 0 0 0 3 
SOLUTION 
a. Without using Theorem 7.3, 
A-2 0 0 
|Ar -A| = 1 A-I O} = A — 2) — 1) + 3). 
—5 —-3 A+3 
So, the eigenvalues are A, = 2,4, = 1, and A, = —3, which are the main diagonal 


entries of A. 


b. In this case, use Theorem 7.3 to conclude that the eigenvalues are the main diagonal 
entries 1, = —1, 4, = 2,A, = 0,A, = —4, and A, = 3. 


LINEAR Eigenvalues and eigenvectors are useful for modeling 
ALGEBRA real-life phenomena. For example, consider an experiment 
to determine the diffusion of a fluid from one flask to 
APPLIED another through a permeable membrane and then out 
of the second flask. If researchers determine that the flow 
rate between flasks is twice the volume of fluid in the first 
flask and the flow rate out of the second flask is three times 
the volume of fluid in the second flask, then the system 
of linear differential equations below, where y, represents 
the volume of fluid in flask i, models this situation. 


yı = —2y, 

Y'= 2y, — 3y2 
In Section 7.4, you will use eigenvalues and eigenvectors 
to solve such systems of linear differential equations. For 
now, verify that the solution of this system is 


y,= Ci e-2t 
Ya = 2C,e-**' + Coe. 
Shi Yali/Shutterstock.com 
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EIGENVALUES AND EIGENVECTORS 
OF LINEAR TRANSFORMATIONS 


This section began with definitions of eigenvalues and eigenvectors in terms of 
matrices. Eigenvalues and eigenvectors can also be defined in terms of linear 
transformations. A number À is an eigenvalue of a linear transformation T: V— V 
when there is a nonzero vector x such that T(x) = Ax. The vector x is an eigenvector 
of T corresponding to A, and the set of all eigenvectors of A (with the zero vector) is 
the eigenspace of 1. 

Consider T: R? > R?, whose matrix relative to the standard basis is 


a Standard basi 
= tandard basis: 
a ; ; È j B = {(1, 0, 0), (0, 1, 0), (0, 0, 1)} 


In Example 5 in Section 6.4, you found that the matrix of T relative to the basis 
B' = {(1, 1, 0), (1, — 1, 0), (0, 0, 1)} is the diagonal matrix 


a ae Nonstandard basi 
i _ onstandard basis: 
ae i : k i B' = {(1, 1,0), (1, — 1, 0), (0, O, 1)} 


For a linear transformation T, can you find a basis B’ whose corresponding matrix is 
diagonal? The next example illustrates the answer. 


EXAMPLE 8 Finding Eigenvalues and Eigenspaces 


Find the eigenvalues and a basis for each corresponding eigenspace of 


1 3 0 
A=|3 1 ol 
0 0 -2 
SOLUTION 
A-1 -3 0 
JA — Al = 3 A-1 0 
0 0 A+2 


= [( — 1)? — 9] + 2) 
=(A— 4) + 2) 


so the eigenvalues of A are 1, = 4 and A, = —2. Bases for the eigenspaces are 
B, = {(1, 1, 0)} and B, = {(1, — 1, 0), (0, 0, 1)}, respectively (verify these). 


Example 8 illustrates two results. If T: R? — R? is the linear transformation whose 
standard matrix is A, and B’ is a basis for R° made up of the three linearly independent 
eigenvectors corresponding to the eigenvalues of A, then the matrix A’ for T relative 
to the basis B’ is diagonal. Also, the main diagonal entries of the matrix A’ are the 
eigenvalues of A. 


I 


$ 
J 


cae’ 


Nonstandard oe 
B' = {(1, 1, 0), (1, — 1, 0), (0, 0, 1)} 


Eigenvalues of A | Higenvectors of A | of A 


The next section discusses these results in more detail. 


- 
— 
\ 


A’ = 


oo: 
otn’ o 
WS S 


an 
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7.1 Exercises 


See CalcChat.com for worked-out solutions to odd-numbered exercises. 


Verifying Eigenvalues and Eigenvectors In Exercises 
1-6, verify that 1, is an eigenvalue of A and that x; is a 
corresponding eigenvector. 
L a=[F | A, = 2, x, = (1, 0) 
0 =2) à, ==-2,%, = ©, 1) 


4 -—5] A, =-1,x, = (1,1) 
2 A= i AET 

f p! l = 2, x, = (5, 2) 

2 3 1) 4 =2,x, = (1,0,0) 
3.A=|0 -1 2],4,=-1,x,=(1,-1,0) 

0 0 3) %=3,x = G12) 

-2 2 -3] A, =5,x, =(1,2,-1) 
4A=| 2 1 6], A, = -3,x, =(—2,1,0) 

-1 = 2; 0 A; = = 35 X; = (3, 0, 1) 

0 1 0 
5 A=|0 0 1ļĵ4=1,x,=(1,1,1) 

1 0 0 

4 -1 32) 4 =4,x, = (1,0,0) 
GA=|0 2 1ļ à% =2,x, = (1,2,0) 

0 O 3] As =3,x; = (-2,1,1) 


7. Use A, À;, and x; from Exercise 1 to show that 
(a) A(cx,) = 2(cx,) for any real number c. 
(b) A(cx,) = —2(cx,) for any real number c. 

8. Use A, A,, and x; from Exercise 4 to show that 
(a) A(cx,) = 5(cx,) for any real number c. 
(b) A(cx,) = —3(cx,) for any real number c. 


(c) A(cx3) = —3(cx;) for any real number c. 


Determining Ejigenvectors In Exercises 9-12, 
determine whether x is an eigenvector of A. 


_|7 2 (a) x = (1, 2) 
A |; ‘| (b) x = (2, 1) 
(c) x = (1, —2) 
(d) x = (-1,0) 
_|-3 10 (a) x = (4,4) 
ee -| 5 >| (b) x = (—8, 4) 
(c) x = (—4, 8) 
(d) x = (5, —3) 
=f =i i (a) x = (2, —4, 6) 
1.4=|-2 0 -2 (b) x = (2, 0, 6) 
3-3 1 (c) x = (2, 2,0) 
(dd) x = (-1,0,1) 
1 0 5] (@)x=(,1,0) 


(b) x = (—5, 2, 1) 
1-2 9| © x = (0,0,0) 


(d) x = (2/6 — 3, -2/6 + 6, 3) 


Finding Eigenspaces in R? Geometrically In Exercises 
13 and 14, use the method shown in Example 3 to find the 
eigenvalue(s) and corresponding eigenspace(s) of A. 


1 0 1 k 
past] ma 4 


Characteristic Equation, Eigenvalues, and Eigenvectors 
In Exercises 15-28, find (a) the characteristic equation 
and (b) the eigenvalues (and corresponding eigenvectors) 
of the matrix. 


6 -3 1 -4 
JEg) |) g] 
1 2 -2 4 
wji 2 wf? 4] 
ba i 
19. | , 20. | | 
5 =I 5 0 
2-2 3 3 2 1 
21. f 3 -2 22. f 0 2 
0-1 2 0o 2 0 
1 2 -2 3 2 -3 
23. -2 5 -2 24. = -4 9 
-6 6 -3 -1 -2 5 
1 -3 5 
0 -3 5 2 2 
25. = 4 —10 26. = B 10 
0 0 4 3 2 3 
2 0 0 0 5 0 0 0 
0 2 0 0 1 4 0 0 
le w 2 i “le @ a a 
0 0 4 0 0 0 0 4 


AB Finding Eigenvalues In Exercises 29-40, use a 


software program or a graphing utility to find the 
eigenvalues of the matrix. 


1 1 i l 
a| 7 l a| : l 
mgo T3 T T2 
2 4 2 1 2 - 
33. |1 0 1 34. |1 0 
1 -4 1-1 2 
3 -} 5 , 0 5 
35.|-3 -4 -i 36. |-2 5 | 
0 0 4 1 0 3 
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(=) 39. 


i ¢ 2 3 1 1 0 0 
2 2 4 6| æ. |4 4 0 0 
O37); 3 6 9f O%lo o 1 1 
4 4 8 1 0 0 2 2 


-1 
@ 4. | _, 


| 

SCORW N OF O 
w 
io) 


Eigenvalues of Triangular and Diagonal Matrices In 
Exercises 41-44, find the eigenvalues of the triangular 
or diagonal matrix. 


2 i l -5 0 0 
4.0 3 4 42.) 3 7 0 
0 0 1 -2 3 
-6 0 0 0 3b 0 0 0 
0 5 0 0 0 3 0o 0 
i 9 goa ol “lo a a d 
0o © 0 —4 0 0 0 È 
Eigenvalues and Eigenvectors of Linear 


Transformations In Exercises 45-48, consider the 
linear transformation T: R” — R” whose matrix A relative 
to the standard basis is given. Find (a) the eigenvalues of 
A, (b) a basis for each of the corresponding eigenspaces, 
and (c) the matrix A’ for T relative to the basis B’, where 
B' is made up of the basis vectors found in part (b). 


2 =2 —8 16 
as. |i =] w S] 
0 2 =l 3 1 4 
47. | -1 3 1 48. | 2 4 0 
0 0 =l 5 5 6 


Cayley-Hamilton Theorem In Exercises 49-52, 
demonstrate the Cayley-Hamilton Theorem for the 
matrix A. The Cayley-Hamilton Theorem states that a 
matrix satisfies its characteristic equation. For example, 
the characteristic equation of 


asl 3] 


is 1? — 61 + 11 = 0, and by the theorem you have 


A? — 6A + 11I, = 0. 
5 0 6 -1 
49 a=| 3 | so. a= |$ ;| 
1 0 -4 -3 1 0 
5.a=|0 3 4 52.A=|-1 3 2 
2 0 0 4 3 
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53. Perform each computational check on the eigenvalues 
found in Exercises 15-27 odd. 


(a) The sum of the n eigenvalues equals the trace of the 
matrix. (Recall that the trace of a matrix is the sum 
of the main diagonal entries of the matrix.) 


(b) The product of the n eigenvalues equals |A]. 


(When J is an eigenvalue of multiplicity k, remember 
to use it k times in the sum or product of these 
checks.) 


54. Perform each computational check on the eigenvalues 
found in Exercises 16—28 even. 


(a) The sum of the n eigenvalues equals the trace of the 
matrix. (Recall that the trace of a matrix is the sum 
of the main diagonal entries of the matrix.) 


(b) The product of the n eigenvalues equals |A]. 


(When J is an eigenvalue of multiplicity k, remember 
to use it k times in the sum or product of these 
checks.) 


55. Show that if A is an n x n matrix whose ith row is 
identical to the ith row of J, then 1 is an eigenvalue of A. 


56. Proof Prove that A = 0 is an eigenvalue of A if and 
only if A is singular. 

57. Proof For an invertible matrix A, prove that A and 
A`! have the same eigenvectors. How are the eigenvalues 
of A related to the eigenvalues of A~!? 


58. Proof Prove that A and A” have the same eigenvalues. 
Are the eigenspaces the same? 


59. Proof Prove that the constant term of the characteristic 
polynomial is +|A]. 

60. Define T: R? — R? by 
T(v) = proja V 
where u is a fixed vector in R?. Show that the eigenvalues 
of A (the standard matrix of T) are 0 and 1. 


61. Guided Proof Prove that a triangular matrix is 
nonsingular if and only if its eigenvalues are real and 
nonzero. 


Getting Started: This is an “if and only if” statement, 
so you must prove that the statement is true in both 
directions. Review Theorems 3.2 and 3.7. 


(i) To prove the statement in one direction, assume 
that the triangular matrix A is nonsingular. Use 
your knowledge of nonsingular and triangular 
matrices and determinants to conclude that the 
entries on the main diagonal of A are nonzero. 


(ii) A is triangular, so use Theorem 7.3 and part (i) to 
conclude that the eigenvalues are real and nonzero. 


(iii) To prove the statement in the other direction, 
assume that the eigenvalues of the triangular 
matrix A are real and nonzero. Repeat parts (i) and 
(ii) in reverse order to prove that A is nonsingular. 
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62. Guided Proof Prove that if A? = O, then O is the 
only eigenvalue of A. 


Getting Started: You need to show that if there exists 
a nonzero vector x and a real number J such that 
Ax = Ax, then if A? = O, A must be zero. 


(i) A? = A> A, so you can write A2x as A(Ax). 


(ii) Use the fact that Ax = Àx and the properties of 
matrix multiplication to show that A?x = Ax. 


(iii) A? is a zero matrix, so you can conclude that À 
must be zero. 


63. Proof Prove that the multiplicity of an eigenvalue is 
greater than or equal to the dimension of its eigenspace. 


64. CAPSTONE An nxn matrix A has the 


characteristic equation 

jar — AJ = +2A-DA-3)2=0. 
(a) What are the eigenvalues of A? 
(b) What is the order of A? Explain. 


(c) Is AJ — A singular? Explain. 


(d) Is A singular? Explain. (Hint: Use the result of 
Exercise 56.) 


65. When the eigenvalues of 


are A, = 0 and A, = 1, what are the possible values of 
a and d? 


66. Show that 


0 1 
A= 
j-i ol 
has no real eigenvalues. 


True or False? In Exercises 67 and 68, determine 
whether each statement is true or false. If a statement 
is true, give a reason or cite an appropriate statement 
from the text. If a statement is false, provide an example 
that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


67. (a) The scalar À is an eigenvalue of an n x n matrix 
A when there exists a vector x such that Ax = Ax. 


(b) To find the eigenvalue(s) of an n x n matrix A, 
you can solve the characteristic equation 
det(AJ — A) = 0. 
68. (a) Geometrically, if A is an eigenvalue of a matrix A 
and x is an eigenvector of A corresponding to 
A, then multiplying x by A produces a vector Àx 
parallel to x. 


(b 


wm 


If A is an n x n matrix with an eigenvalue À, then 
the set of all eigenvectors of À is a subspace of R”. 


Finding the Dimension of an Eigenspace In 
Exercises 69-72, find the dimension of the eigenspace 
corresponding to the eigenvalue A = 3. 


3 0 0 3 1 0 
69. A =|0 3 0 70. A=|0 3 0 
0 0 3 0 0 3 
3 1 0 3 1 1 
71. A=|0 3 1 72. A=|0 3 1 
0 0 3 0 0 3 


73. Calculus Let T: C’[0,1]—>C[0,1] be the linear 
transformation T(f) =f’. Show that à = 1 is an 
eigenvalue of T with corresponding eigenvector 


fa) = e. 
74. Calculus For the linear transformation in Exercise 
73, find the eigenvalue corresponding to the eigenvector 


f(x) =e. 
75. Define T: P, > P, by 
Tla + ax + a,x?) = (—3a, + 5a) + 
(—4a + 4a, — 10a,)x + 4a,x?. 
Find the eigenvalues and the eigenvectors of T relative 
to the standard basis {1, x, x}. 
76. Define T: P, — P, by 
T(dy tax tar) = la + a, — a) + 
(—a, + 2a,)x = ayx?. 
Find the eigenvalues and eigenvectors of T relative to 
the standard basis {1, x, x7}. 
77. Define T: M,,—M,, by 


a b\\ _ a-ctd b+d 

Ç d —2a+2c-—2d 20FF24 
Find the eigenvalues and eigenvectors of T relative to 
the standard basis 


EE S 


78. Find all values of the angle 0 for which the matrix 
= P 0 —sin J 


sin cos@ 


has real eigenvalues. Interpret your answer geometrically. 


79. What are the possible eigenvalues of an idempotent 
matrix? (Recall that a square matrix A is idempotent 
when A? = A.) 


80. What are the possible eigenvalues of a nilpotent matrix? 
(Recall that a square matrix A is nilpotent when there 
exists a positive integer k such that A‘ = 0.) 


81. Proof Let A be an n x n matrix such that the sum 
of the entries in each row is a fixed constant r. Prove 
that r is an eigenvalue of A. Illustrate this result with 
an example. 
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7.2  Diagonalization 


Find the eigenvalues of similar matrices, determine whether a matrix 
A is diagonalizable, and find a matrix P such that P~'AP is diagonal. 


Find, for a linear transformation T: V> V, a basis B for V such that 
the matrix for T relative to Bis diagonal. 


THE DIAGONALIZATION PROBLEM 


The preceding section discussed the eigenvalue problem. In this section, you will 
look at another classic problem in linear algebra called the diagonalization problem. 
Expressed in terms of matrices*, the problem is “for a square matrix A, does there exist 
an invertible matrix P such that P~'AP is diagonal?” 

Recall from Section 6.4 that two square matrices A and B are similar when there 
exists an invertible matrix P such that B = P~'AP. 

Matrices that are similar to diagonal matrices are called diagonalizable. 


Definition of a Diagonalizable Matrix 


Ann x n matrix A is diagonalizable when A is similar to a diagonal matrix. That 
is, A is diagonalizable when there exists an invertible matrix P such that P~'AP 
is a diagonal matrix. 


With this definition, the diagonalization problem can be stated as “which square 
matrices are diagonalizable?” Clearly, every diagonal matrix D is diagonalizable, 
because D = I~'DI, where J is the identity matrix. Example 1 shows another example 
of a diagonalizable matrix. 


EXAMPLE 1 A Diagonalizable Matrix 


The matrix from Example 5 in Section 6.4 


1 3 0 
A={|3 1 0 
0 2 


is diagonalizable because 


1 1 0 
P=)1 -1 0 
0 0 1 


has the property that 


4 0 0 
P'AP=|0 -2 0}. 


0 0 -2 | 


As suggested in Example 8 in the preceding section, the eigenvalue problem is 
related closely to the diagonalization problem. The next two theorems shed more 
light on this relationship. The first theorem tells you that similar matrices have the 
same eigenvalues. 


*At the end of this section, the diagonalization problem will be expressed in terms of linear transformations. 
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THEOREM 7.4 Similar Matrices Have the Same Eigenvalues 


If A and B are similar n x n matrices, then they have the same eigenvalues. 


PROOF 


A and B are similar, so there exists an invertible matrix P such that B = P~'AP. By the 
properties of determinants, it follows that 


AI — B| = |AI— P~'AP 
REMARK | | E | 
a = |PIP — P~'AP| 
Check that A and D are similar 4 
by showing that they satisfy = |P~'QI — A)P| 
the matrix equation D = P'AP, = |Po||Ar — A||P| 
wniere = |P-P|JAI — A| 
1 0 0 = |A- Al. 
PANT 1 1l , 
1 2 This means that A and B have the same characteristic polynomial. So, they must have 
the same eigenvalues. | 


In fact, the columns of P are 


eigenvectors of A corresponding = a4 a F P , 
to the eigenvalues 1, 2, and 3. EXAMPLE 2 Finding Eigenvalues of Similar Matrices 
(Verify this.) 


The matrices A and D are similar. 


1 0 0 1 0 0 
A= |-1 1 1} and D=/0 2 0 
=1 =2 4 0 0 3 


Use Theorem 7.4 to find the eigenvalues of A. 
SOLUTION 


D is a diagonal matrix, so its eigenvalues are the entries on its main diagonal—that 
is, A, = 1, A, = 2, and A, = 3. Matrices A and D are similar, so you know from 
Theorem 7.4 that A has the same eigenvalues. Check this by showing that the 
characteristic polynomial of A is |AJ — A] = (A — 1)(A — 2)(A — 3). 


The two diagonalizable matrices in Examples 1 and 2 provide a clue to the 
diagonalization problem. Each of these matrices has a set of three linearly independent 
eigenvectors. (See Example 3.) This is characteristic of diagonalizable matrices, as 
stated in Theorem 7.5. 


THEOREM 7.5 Condition for Diagonalization 


Ann X n matrix A is diagonalizable if and only if it has n linearly independent 
eigenvectors. 


PROOF 


First, assume A is diagonalizable. Then there exists an invertible matrix P such that 
PAP = D is diagonal. Letting the column vectors of P be p,, p>,. - -, Pp, and the 


main diagonal entries of D be A,, A5,. . . ,A,,, produces 
Ay, O 2c 0 
0 A, ... O 
PD=([p, œ... Pll. 7 | | =p, Asp... . Appa]: 
0 0 ...A 
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P~'AP = D, so AP = PD, which implies 
[Ap, Ap,...Ap,]=[\,p, A.p,.. - A,p,]- 


In other words, Ap; = A,p; for each column vector p;. This means that the column 
vectors p; of P are eigenvectors of A. Moreover, P is invertible, so its column vectors 
are linearly independent. So, A has n linearly independent eigenvectors. 


Conversely, assume A has n linearly independent eigenvectors p,, P2,- . -> Ph 
with corresponding eigenvalues 44, A,,. . .,A,,. Let P be the matrix whose columns 
are these n eigenvectors. That is, P=[p, p,.. . p,]. Each p; is an eigenvector of 


A, so you have Ap, = A,p, and 
AP = Alp, Po--- P,.] = LAP, MP2 ene 1, Prl- 


The right-hand matrix in this equation can be written as the matrix product below. 


A, 0... 0 
0 A, ... 0 
[AiP 1,P> ef es dP, = Lp, P2 paa P,,| : = : = PD 
0 0... A, 
Finally, the vectors p,,p5,...,p, are linearly independent, so P is invertible 
and you can write the equation AP = PD as P~'AP = D, which means that A is 
diagonalizable. i 


A key result of this proof is the fact that for diagonalizable matrices, the columns 
of P consist of n linearly independent eigenvectors. Example 3 verifies this important 
property for the matrices in Examples 1 and 2. 


EXAMPLE 3 Diagonalizable Matrices 


a. The matrix A in Example 1 has the eigenvalues and corresponding eigenvectors 


below. 
1 1 0 
A,=4p,=]1) 4,=-2,p,=|-1) A,=—-2,p, =]0 
0 0 1 
The matrix P whose columns correspond to these eigenvectors is 
1 1 0 
P=)1 -1 0 |. 
0 0 1 


Moreover, P is row-equivalent to the identity matrix, so the eigenvectors p,, p>, and 
p; are linearly independent. 


b. The matrix A in Example 2 has the eigenvalues and corresponding eigenvectors 


below. 
1 0 (0) 
A, =1,p,=|1) 4=2p=]|l|; 4% =3,p=]1 
1 1 2 


The matrix P whose columns correspond to these eigenvectors is 


1 0 0 
P=)1 1 1}. 
1 1 2 


Again, P is row-equivalent to the identity matrix, so the eigenvectors p,, p2, and p; 
are linearly independent. 
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The second part of the proof of Theorem 7.5 and Example 3 suggest the steps for 
diagonalizing a matrix listed below. 


Steps for Diagonalizing a Square Matrix 


Let A be ann x n matrix. 


1. Find n linearly independent eigenvectors p,, p,,. . ., P, for A (if possible) 
with corresponding eigenvalues 1,,1,,. . .,A,. If n linearly independent 
eigenvectors do not exist, then A is not diagonalizable. 

. Let P be the n x n matrix whose columns consist of these eigenvectors. 
That is, P = [p] p.... P,|.- 

. The diagonal matrix D = P~'AP will have the eigenvalues 1,,A,,. . .,A, 
on its main diagonal. Note that the order of the eigenvectors used to form 
P will determine the order in which the eigenvalues appear on the main 
diagonal of D. 


EXAM PLE 4 Diagonalizing a Matrix 


Show that the matrix A is diagonalizable. 


1 =I =1 
A= 1 3 1 
=3 1 =1 


Then find a matrix P such that P~!AP is diagonal. 


SOLUTION 
The characteristic polynomial of A is |AJ — A| = (A — 2)(A + 2)(A — 3). (Verify this.) 
So, the eigenvalues of A areA, = 2,A, = —2, and 1, = 3. From these eigenvalues, you 


obtain the reduced row-echelon forms and corresponding eigenvectors below. 


Eigenvector 
1 1 1 0 1 =] 
2I- A= 1 1 1 => 0 1 0 0 
3z =] 0 0 0 1 
1 
= 1 1 0 =3 1 
2-A=|-1 -5 -1| => |o ı i -1 
2 1 1 1 0 1 =] 
3I-A=]-1 0 =1 => (0 i = 1 
3 = 4 0 0 0 1 


Form the matrix P whose columns are the eigenvectors just obtained. 


-1 1-1 
P=| 0-1 1 
1 4 1 


This matrix is nonsingular (check this), which implies that the eigenvectors are linearly 
independent and A is diagonalizable. So, it follows that 


2 0 0 
P“AP=|0 -2 ol. 


0 0 3 P| 
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EXAMPLE 5 Diagonalizing a Matrix 


Show that the matrix A is diagonalizable. 


1 0 0 0 
0 1 5 —10 
ae a a 0 
1 0 0 2 
Then find a matrix P such that P~!AP is diagonal. 
SOLUTION 


In Example 6 in Section 7.1, you found that the three eigenvalues of A are A, = 1, 
A, = 2, and 1, = 3, and that they have the eigenvectors listed below. 


0] [-2 0 0 
i} | 0 5 -5 
alal al Azil æl o 
o}| 1 0 1 


The matrix whose columns consist of these eigenvectors is 


0 =2 0 0 
1 0 5. =5 
0 2 1 of 
0 1 0 1 


P= 


P is invertible (check this), so its column vectors form a linearly independent set. This 
means that A is diagonalizable, and 


1 0 0 0 
0 1 0 0 
—] = 
P'aP=| a a ol 
0 0 0 3 | 


EXAMPLE 6 A Matrix That Is Not Diagonalizable 


Show that the matrix A is not diagonalizable. 


SOLUTION 


A is triangular, so the eigenvalues are the entries on the main diagonal. The only 
eigenvalue is 1 = 1. The matrix (J — A) has the reduced row-echelon form below. 


0 =2 0 1 
I-A= => 
k d [o o| 
This implies that x, = 0, and letting x, = ¢, you can write every eigenvector of A in 
the form 


SONORI 


So, A does not have two linearly independent eigenvectors, and you can conclude that 
A is not diagonalizable. 
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REMARK 


The condition in Theorem 7.6 is 
sufficient but not necessary for 
diagonalization, as demonstrated 
in Example 5. In other words, a 
diagonalizable matrix need not 
have distinct eigenvalues. 


For a square matrix A of order n to be diagonalizable, the sum of the dimensions of 
the eigenspaces must be equal to n. This can happen when A has n distinct eigenvalues. 
So, you have the next theorem. 


THEOREM 7.6 Sufficient Condition for Diagonalization 


If an nxn matrix A has n distinct eigenvalues, then the corresponding 
eigenvectors are linearly independent and A is diagonalizable. 


PROOF 
Let A,,1,,. . .,A,, be n distinct eigenvalues of A with corresponding eigenvectors X}, 
X>,. . .,X,. To begin, assume the set of eigenvectors is linearly dependent. Moreover, 


consider the eigenvectors to be ordered so that the first m eigenvectors are linearly 
independent, but the first m + 1 are linearly dependent, where m < n. Then x,,, , can 
be written as a linear combination of the first m eigenvectors: 


Xm+1 — 1X1 + C2X2 T e g CmXm Equation 1 
where the c;s are not all zero. Multiplication of both sides of Equation 1 by A 


yields 
AXn+1 = ACX; + ACX, +> >- + ACX 


mm 


Now Ax; = À;X; 


i= 1,2,...,m+ 1, so you have 
dint Xm+1 = EAX + AX, ++ + CAA Equation 2 


m “mm 


Multiplication of Equation 1 by À„ +; yields 


Àm+1Xm+1 7 CA ine 1X nd Codi + 1% oe eEG Ngee Equation 3 


m 


Subtracting Equation 2 from Equation 3 produces 
C1Am+1 a 1,)x, T CoAm +1 ~ 15)X> ate: hiap Cina E Am)Xm = 0 


and, using the fact that the first m eigenvectors are linearly independent, all coefficients 
of this equation must be zero. That is, 


Am E Ài) = CoAm +1 T da) G CaA nri T Àm) =0. 


All the eigenvalues are distinct, so it follows that c; = 0, i = 1,2,. . .,m. But this 
result contradicts our assumption that x,,,, can be written as a linear combination of 
the first m eigenvectors. So, the set of eigenvectors is linearly independent, and from 
Theorem 7.5, you can conclude that A is diagonalizable. 


EXAMPLE 7 


Determining Whether a 
Matrix Is Diagonalizable 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


Determine whether the matrix A is diagonalizable. 


I =2 1 
A=|0 0 1 
0 0 =3 
SOLUTION 
A is a triangular matrix, so its eigenvalues are the main diagonal entries 1, = 1, A, = 0, 
and A, = —3. Moreover, these three values are distinct, so you can conclude from 
Theorem 7.6 that A is diagonalizable. | 
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DIAGONALIZATION AND LINEAR TRANSFORMATIONS 


So far in this section, the diagonalization problem has been in terms of matrices. 
In terms of linear transformations, the diagonalization problem can be stated as: For a 
linear transformation 


T: Vo V 


does there exist a basis B for V such that the matrix for T relative to B is diagonal? 
The answer is “yes” when the standard matrix for T is diagonalizable. 


Finding a Basis 


Let T: R? — R? be the linear transformation represented by 
T (x1, X55 X3) = (X) — X> — Xz, xX, + 3x, + X3, —3x, +X — i): 


If possible, find a basis B for R? such that the matrix for T relative to B is diagonal. 


SOLUTION 
The standard matrix for T is 
1 -1 =f 
A= 1 3 1]. 
=3 1 -l 


From Example 4, you know that A is diagonalizable. So, the three linearly independent 
eigenvectors found in Example 4 can be used to form the basis B. That is, 


B = {(-1, 0, 1), (1, — 1, 4), (— 1, 1, 1}. 
The matrix for T relative to this basis is 


2 0 0 
D=|0 -2 0|. 


0 0 3 | 


LINEAR Genetics is the science of heredity. A mixture of chemistry 
and biology, genetics attempts to explain hereditary evolution 
ALGEBRA 
and gene movement between generations based on the 
APPLIED deoxyribonucleic acid (DNA) of a species. Research in the 
area of genetics called population genetics, which focuses 
on genetic structures of specific populations, is especially 
popular today. Such research has led to a better 
understanding of the types of genetic inheritance. For 
example, in humans, one type of genetic inheritance is called 
X-linked inheritance (or sex-linked inheritance), which refers 
to recessive genes on the X chromosome. Males have 
one X and one Ychromosome, and females have two 
X chromosomes. If a male has a defective gene on the 
X chromosome, then its corresponding trait will be expressed 
because there is not a normal gene on the Y chromosome 
to suppress its activity. With females, the trait will not be 
expressed unless it is present on both X chromosomes, 
which is rare. This is why inherited diseases or conditions 
are usually found in males, hence the term sex-linked 
inheritance. Some of these include hemophilia A, Duchenne 
muscular dystrophy, red-green color blindness, and male 
pattern baldness. Matrix eigenvalues and diagonalization 
can be useful for coming up with mathematical models to 
describe X-linked inheritance in a population. 


Sergey Nivens/Shutterstock.com 
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7.2 Exercises 


Diagonalizable Matrices and Eigenvalues In 
Exercises 1-6, (a) verify that A is diagonalizable by 
finding P—'AP, and (b) use the result of part (a) and 
Theorem 7.4 to find the eigenvalues of A. 


—11 36 =3 _=4 
Á as oh? = e E 
3 1 
A E ie =|; il 
3 -2 1 2 
j a=) F f A 
4 -5 1 5 
S 3 ee, d 
= i g 0 i= 
5. A= 0 3 0|,P =|0 4 0 
4 -2 5 1 2 2 
0.80 0.10 0.05 0.05 
0.10 0.80 0.05 0.05 
0.05 0.05 0.80 0.10) 
0.05 0.05 0.10 0.80 


i =i O 1 
1 =i 0 =i 
P= ai 1 0 
1 «=f 0 


Diagonalizing a Matrix In Exercises 7-14, find (if 
possible) a nonsingular matrix P such that P—'AP is 
diagonal. Verify that P'AP is a diagonal matrix with 
the eigenvalues on the main diagonal. 

1 

7 

0 


na|] sa] 


(See Exercise 20, 
Section 7.1.) 


Nie Ble 


(See Exercise 15, 
Section 7.1.) 


2 =2 3 3 2 1 
9 A=]0 3 = 2 10. A =| 0 0 2 
0 =l 2 0 2 0 


(See Exercise 22, 
Section 7.1.) 


(See Exercise 21, 
Section 7.1.) 


1 2 =2 3 2, F9 
11. A= |-2 5 -2| 12. A=|-3 —4 9 
=6 6 =3 =l =2 5 


(See Exercise 24, 
Section 7.1.) 


(See Exercise 23, 
Section 7.1.) 


1 0 0 2 0 0 
13. A=] 2 1 14.A=|4 4 0 
1 0 2 0 4 4 


See CalcChat.com for worked-out solutions to odd-numbered exercises. 


O 21. 


© 22. 


E [m] = 
Showing That a Matrix Is Not Diagonalizable 


In Exercises 15-22, show that the matrix is not 
diagonalizable. 


0 0 i 3 
15 16. 
sal 6 le | 
1 7 1 0 
17. f | 18. |; l 
I =2 1 3 2 =2 
9.0 1 4 20./0 -2 3 
0 0 2 0 0 -2 
1 0 -1 1 
0 1 0 1 
=2 0 2 =2 


0 2 0 2 
(See Exercise 39, Section 7.1.) 


[l =3 3 3 

=f 4 -3 -3 

—2 0 1 1 

1 0 0 0 
(See Exercise 40, Section 7.1.) 


Determining a Sufficient Condition for Diagonalization 
In Exercises 23-26, find the eigenvalues of the 
matrix and determine whether there is a sufficient 
number of eigenvalues to guarantee that the matrix 
is diagonalizable by Theorem 7.6. 


1 1 2 0 
nf Y nf 9 
=} =] 3 4 3. -=2 
25. 3 4 -9 26. | 0 1 1 
1 2. => 0 0 =2 


Finding a Basis In Exercises 27-30, find a basis B for 
the domain of T such that the matrix for T relative to B 
is diagonal. 
27. T: R >R: T(x, y) = (x + y, x + y) 
28. T: R? —> RÈ: 

T(x, yz) = (—2x + 2y = 3z, 2x + y = 6z, x — 2y) 
29. T: P, > P,: T(a + bx) =a + (a + 2b)x 
30. T: P; > P3: 

T(c + bx + ax?) = 


(3c + a) + (2b + 3a)x + ax? 


31. Proof Let A be a diagonalizable n x n matrix and let 
P be an invertible n x n matrix such that B = P~!AP is 
the diagonal form of A. Prove that A* = PB‘P~!, where 
k is a positive integer. 
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32. Let A,,A,,...,A, be n distinct eigenvalues of an 
n x n matrix A. Use the result of Exercise 31 to find the 
eigenvalues of A¥. 


Finding a Power of a Matrix In Exercises 33-36, use 
the result of Exercise 31 to find the power of A shown. 


33. A= | p has 34. A = E ala 


-6 -11 2 0 
2 0 -2 
35. A=|0 2 =2ļ,A5 
3 0 -3 
2 3 -2 
36. A=|-2 -5 0ļ|,A8 
-2 -1 4 


True or False? In Exercises 37 and 38, determine 
whether each statement is true or false. If a statement 
is true, give a reason or cite an appropriate statement 
from the text. If a statement is false, provide an example 
that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


37. (a) If A and B are similar n x n matrices, then they 
always have the same characteristic polynomial 
equation. 


(b) The fact that an n x n matrix A has n distinct 
eigenvalues does not guarantee that A is 
diagonalizable. 


38. (a) If A is a diagonalizable matrix, then it has n linearly 
independent eigenvectors. 


(b) If ann x n matrix A is diagonalizable, then it must 
have n distinct eigenvalues. 


39. Are the two matrices similar? If so, find a matrix P such 
that B = P~'AP. 


1 0 0 3 0 0 
A= /0 2 0 B= {0 2 
0 0 3 0 0 1 
40. Calculus For a real number x, you can define e* by 
the series 
x2 gi x4 
e=l+x+ ae a ap 


In a similar way, for a square matrix X, you can define 
e* by the series 
1 1 1 


X— 2 3 de uaa 
e P+X+ 5x va + aye + 


Evaluate e*, where X is the square matrix shown. 


_fl o _fi 0 
@ x=[4 Œ x= ol 


ofo 1 fe o0 
© x=|} ol @ x=[5 | 
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41. Writing Can a matrix be similar to two different 
diagonal matrices? Explain. 


42. Proof Prove that if matrix A is diagonalizable, then 
A’ is diagonalizable. 

43. Proof Prove that if matrix A is diagonalizable with n 
real eigenvaluesA,,A,,...,A,,then|A] = A: A 

44. Proof Prove that the matrix 


a b 
A= 
i il 
is diagonalizable when —4bc < (a — d} and is not 
diagonalizable when —4bc > (a — d}. 
45. Guided Proof Prove that if the eigenvalues of a 


diagonalizable matrix A are all +1, then the matrix is 
equal to its inverse. 


n’ 


Getting Started: To show that the matrix is equal to its 
inverse, use the fact that there exists an invertible matrix 
P such that D = P~'AP, where D is a diagonal matrix 
with +1 along its main diagonal. 
(i) Let D = P~!AP, where D is a diagonal matrix 
with +1 along its main diagonal. 
(ii) Find A in terms of P, P~!, and D. 


Gii) Use the properties of the inverse of a product of 
matrices and the fact that D is diagonal to expand 
to find A~ !. 

(iv) Conclude that A~! = A. 


46. Guided Proof Prove that nonzero nilpotent matrices 
are not diagonalizable. 
Getting Started: From Exercise 80 in Section 7.1, 
you know that O is the only eigenvalue of the 
nilpotent matrix A. Show that it is impossible for A to 
be diagonalizable. 
(i) Assume A is diagonalizable, so there exists an 
invertible matrix P such that P~-'AP = D, where 
D is the zero matrix. 


(ii) Find A in terms of P, P~!, and D. 


Gii) Find a contradiction and conclude that nonzero 
nilpotent matrices are not diagonalizable. 


47. Proof Prove that if A is a nonsingular diagonalizable 
matrix, then A~! is also diagonalizable. 


48. CAPSTONE Explain how to determine 
whether an n Xn matrix A is diagonalizable 


using (a) similar matrices, (b) eigenvectors, and 
(c) distinct eigenvalues. 


Showing That a Matrix Is Not Diagonalizable In 
Exercises 49 and 50, show that the matrix is not 
diagonalizable. 


4 k 0 0 
49. f fleo 50. k oleo 
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7.3 Symmetric Matrices and Orthogonal Diagonalization 


Recognize, and apply properties of, symmetric matrices. 
Recognize, and apply properties of, orthogonal matrices. 


Find an orthogonal matrix P that orthogonally diagonalizes 
a symmetric matrix A. 


SYMMETRIC MATRICES 


For most matrices, you must go through much of the diagonalization process before 
determining whether diagonalization is possible. One exception is with a triangular 
matrix that has distinct entries on the main diagonal. Such a matrix can be recognized as 
diagonalizable by inspection. In this section, you will study another type of matrix that 
is guaranteed to be diagonalizable: a symmetric matrix. Recall the definition below. 


Definition of a Symmetric Matrix 


A square matrix A is symmetric when it is equal to its transpose: A = A’. 


DISCOVERY 


L. Pick an arbitrary EXAMPLE 1 Symmetric Matrices and 
nonsymmetric square Nonsymmetric Matrices 


matrix and calculate its The matrices A and B are symmetric, but the matrix C is not. 

eigenvalues. 0 i 5 3 3 i 

Can you find a a=l 4 3 0 ne p | c=l1 -4 0 
nonsymmetric square 2 0 5 3 1 l 0 5 u 


matrix for which the 


eigenvalues are not real? . . . oe : 
Nonsymmetric matrices have properties that are not exhibited by symmetric 


Now pick an arbitrary matrices, as listed below. 


symmetric matrix and 


calculate its eigenvalues. 1. A nonsymmetric matrix may not be diagonalizable. 
Can you find a 2. A nonsymmetric matrix can have eigenvalues that are not real. For example, 
symmetric matrix for the matrix 
which the eigenvalues 
are not real? A= k E 1 
1 0 


What can you conclude 


about the eigenvalues 


has a characteristic equation of A + 1 = 0. So, its eigenvalues are the imaginary 


of a symmetric matrix? numbers 1, = į and À, = —i. 
See LarsonLinearAlgebra.com 3. For a nonsymmetric matrix, the number of linearly independent eigenvectors 
for an interactive version corresponding to an eigenvalue can be less than the multiplicity of the eigenvalue. 
of this type of exercise. (See Example 6, Section 7.2.) 


Theorem 7.7 lists properties of symmetric matrics. 


THEOREM 7.7 Properties of Symmetric Matrices 


aia ; If A is ann x n symmetric matrix, then the properties listed below are true. 
Theorem 7.7 is called the Real a . 
Spectral Theorem, and the set 1. Ais diagonalizable. 
of eigenvalues of A is called 2. All eigenvalues of A are real. 
the spectrum of A. 3. If A is an eigenvalue of A with multiplicity k, then À has k linearly 


independent eigenvectors. That is, the eigenspace of À has dimension k. 
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A proof of Theorem 7.7 is beyond the scope of this text. The next example proves 
that every 2 x 2 symmetric matrix is diagonalizable. 


Every 2 x 2 Symmetric Matrix 
EXAMPLE 2 Is Diagonalizable 


Prove that a symmetric matrix 
a € 
A= 
i 
is diagonalizable. 


SOLUTION 


The characteristic polynomial of A is 


= =c 


Ar — Al = -c A-—b 


=)? — (a+ b)À + ab- e. 


As a quadratic in A, this polynomial has a discriminant of 
(a + b} — 4(ab — c?) = a? + 2ab + b? — 4ab + 4c? 
= a — 2ab + b + 4c? 
(a — b}? + 4c?. 


This discriminant is the sum of two squares, so it must be either zero or positive. 
If (a — b}? + 4c? = 0, then a = b and c = 0, so A is already diagonal. That is, 


a 0 
A= . 
jo al 
On the other hand, if (a — b)? + 4c? > 0, then by the Quadratic Formula the 


characteristic polynomial of A has two distinct real roots, which means that A has two 
distinct real eigenvalues. So, A is diagonalizable in this case as well. 


Dimensions of the Eigenspaces 
EXAMPLE 3 of a Symmetric Matrix 


Find the eigenvalues of the symmetric matrix 


1 =2 0 0 
=2 1 0 0 
0 0 1 =2 
0 0 -2 1 


A= 


and determine the dimensions of the corresponding eigenspaces. 


SOLUTION 
The characteristic polynomial of A is 
A-1 2 0 0 
2 A-1 0 0 
= = = + 2 = 2 
JAI — A| z "E a| = A +1PA — 3) 

0 0 2 A-1 
So, the eigenvalues of A are A, = —1 and A, = 3. Each of these eigenvalues has 
a multiplicity of 2, so you know from Theorem 7.7 that the corresponding 
eigenspaces also have dimension 2. Specifically, the eigenspace of 1, = —1 has a 


basis of B, = {(1, 1, 0, 0), (0, 0, 1, 1)} and the eigenspace of 1, = 3 has a basis of 
B, = {(1, — 1, 0, 0), (0, 0, 1, — 1)}. (Verify these.) 
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ORTHOGONAL MATRICES 


To diagonalize a square matrix A, you need to find an invertible matrix P such that 
P~'AP is diagonal. For symmetric matrices, the matrix P can be chosen to have the 
special property that P™! = P”. This unusual matrix property is defined below. 


Definition of an Orthogonal Matrix 


A square matrix P is orthogonal when it is invertible and P~! = P". 


. EXAMPLE 4 Orthogonal Matrices 


l =i 
a. The matrix P = |! | is orthogonal because PT! = P" = k Al 
b. The matrix 
3 4 
53 0 =; 
P=(|0 1 0 
4 3 
3 0 35 
is orthogonal because 
3 4 
53 0 35 
Pap =|) O ol. 
4 3 


In Example 4, the columns of the matrices P form orthonormal sets in R? and R?, 
respectively (verify this), which suggests the next theorem. 


THEOREM 7.8 Property of Orthogonal Matrices 


An n x n matrix P is orthogonal if and only if its column vectors form an 
orthonormal set. 


PROOF 


To prove the theorem in one direction, assume that the column vectors of P form an 
orthonormal set: 


P=(p, P... Pal 
Pi Piz +++ Pin 
P21 P22 +++ Pan 
Pni Pn2 Soe Pnn 


Then the product P7P has the form 


Pi° Pi: Pict Po --- Pi’ Pr 
PTP = Pe Pa “Pa ee’ Pa” Phi, 
P, ° Pi P, ° P2 E Teh Pn ° Ph 
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The set 
{Pi Poss» -> Pal 


is orthonormal, so you have 
PoP, =07i# 7 and p;* p;= lpi = 1. 


So, the matrix composed of dot products has the form 


1 0... 0 
O O sza I 


This implies that PT = P™!, so P is orthogonal. 
Conversely, if P is orthogonal, then reverse the steps above to verify that the 
column vectors of P form an orthonormal set. 


EXAMPLE 5 An Orthogonal Matrix 


Show that 


T 2 
3 


D WIN 


2 1 
Bei J5 
2 4 5 

3/5 3/5 3/5 


is orthogonal by showing that PT = P~'. Then show that the column vectors of P form 
an orthonormal set. 


SOLUTION 
1 2 2})1 2 2 
3 3 AIS. 2/5 | 34/5 
2 1 2 1 4 
PPT = =|=1 
oa J5 = wa S75)" 
2 4 5 2 0 5 
3/5 3/5 3y5||3 3/5 
so it follows that P” = P~!. Moreover, letting 
1 2 
3 3 Z 
3 
P, = 2 p- = l and p, = 0 
1 > P2 , a 
: : 5 
35 45 a 
produces 
Pi * Po = Pi * P3 = Po * P3 = O 
and 
lell = [poll = Ihpsll = 1. 
So, {P1, P2» P3} is an orthonormal set, as guaranteed by Theorem 7.8. | 
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It can be shown that for a symmetric matrix, the eigenvectors corresponding to 
distinct eigenvalues are orthogonal. The next theorem states this property. 


THEOREM 7.9 Property of Symmetric Matrices 


Let A be ann x n symmetric matrix. If 1, and À, are distinct eigenvalues of A, 
then their corresponding eigenvectors x, and x, are orthogonal. 


PROOF 
Let A, and A, be distinct eigenvalues of A with corresponding eigenvectors x, and x. 
So, Ax, = 4,x, and Ax, = 1,x,. To prove the theorem, use the matrix form of the dot 
product, x, * X, = x/x,. (See Section 5.1.) Now you can write 
A, (x, * x,) = Ax) > x, 
= (Ax,) * x, 
= (Ax,)’x, 
= (xTA’)x, 
= (x7A)x, A is symmetric, so A = A’. 
= x{(Ax,) 
= x7(1,x,) 


=x? (A2xX2) 


(X; * x). 


This implies that (A, — 4,)(x; + x,) = 0. Also, A, # A,, so it follows that x, + x, = 0, 
which means that x, and x, are orthogonal. 


Eigenvectors of a Symmetric Matrix 


Show that any two eigenvectors of 


“fd 


corresponding to distinct eigenvalues are orthogonal. 


SOLUTION 
The characteristic polynomial of A is 
A- 3 =] 
ar Al -| = i =0- 20 <4) 


which implies that the eigenvalues of A are A, = 2 and A, = 4. Verify that every 
eigenvector corresponding to A, = 2 is of the form 


x, = ie! s#0 


and every eigenvector corresponding to 1, = 4 is of the form 


x, °X, = st— st=0 


which means that x, and x, are orthogonal. T 
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ORTHOGONAL DIAGONALIZATION 


A matrix A is orthogonally diagonalizable when there exists an orthogonal matrix P 
such that P~!'AP = D is diagonal. The important theorem below states that the set of 
orthogonally diagonalizable matrices is precisely the set of symmetric matrices. 


THEOREM 7.10 Fundamental Theorem of Symmetric Matrices 


Let A be an n x n matrix. Then A is orthogonally diagonalizable (and has real 
eigenvalues) if and only if A is symmetric. 


PROOF 
The proof of the theorem in one direction is fairly straightforward. That is, if you 


assume A is orthogonally diagonalizable, then there exists an orthogonal matrix P such 
that D = P~'!AP is diagonal. Moreover, P™! = PT, so you have 


A = PDP“! 
= PDP" 
which implies that 

AT = (PDP*)? 

_ (PT)TDTPT 
= PDP? 
=A. 

So, A is symmetric. 

The proof of the theorem in the other direction is more involved, but it is important 
because it is constructive. Assume A is symmetric. If A has an eigenvalue A of 
multiplicity k, then by Theorem 7.7, A has k linearly independent eigenvectors. Through 
the Gram-Schmidt orthonormalization process, use this set of k vectors to form an 
orthonormal basis of eigenvectors for the eigenspace corresponding to A. Repeat this 
procedure for each eigenvalue of A. The collection of all resulting eigenvectors is 
orthogonal by Theorem 7.9, and you know from the orthonormalization process that the 
collection is also orthonormal. Now let P be the matrix whose columns consist of these 


n orthonormal eigenvectors. By Theorem 7.8, P is an orthogonal matrix. Finally, by 
Theorem 7.5, P~!AP is diagonal. So, A is orthogonally diagonalizable. | 


A] Determining Whether a Matrix 
EXAMPLE 7 Is Orthogonally Diagonalizable 


Which matrices are orthogonally diagonalizable? 


i ți 1 5 2 1 
A=ļ|1 0 1 A&=| 2 1 8 
l1 © 1 -1 8 0 
3 2 6 0 O 
al ; 0 A Ay = Ie | 
SOLUTION 


By Theorem 7.10, the orthogonally diagonalizable matrices are the symmetric ones: 
A, and Ay. | 


As mentioned above, the second part of the proof of Theorem 7.10 is constructive. 
That is, it gives you steps to follow to diagonalize a symmetric matrix orthogonally. 
A summary of these steps is on the next page. 
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Chapter 7 Eigenvalues and Eigenvectors 


Orthogonal Diagonalization of a Symmetric Matrix 


Let A be ann x n symmetric matrix. 


. Find all eigenvalues of A and determine the multiplicity of each. 

. For each eigenvalue of multiplicity 1, find a unit eigenvector. (Find any 
eigenvector and then normalize it.) 

. For each eigenvalue of multiplicity k = 2, find a set of k linearly independent 
eigenvectors. (You know from Theorem 7.7 that this is possible.) If this set is 
not orthonormal, then apply the Gram-Schmidt orthonormalization process. 

. The results of Steps 2 and 3 produce an orthonormal set of n eigenvectors. 
Use these eigenvectors to form the columns of P. The matrix 
PAP = PAP = D will be diagonal. (The main diagonal entries of D 
are the eigenvalues of A.) 


EXAMPLE 8 Orthogonal Diagonalization 


=2 2 
Find a matrix P that orthogonally diagonalizes A = | | 


2 1 
SOLUTION 
1. The characteristic polynomial of A is 
A+2 —2 
-A| = =(+ — 2). 
ar Al | oe il A +30- 2) 
So the eigenvalues are 4} = —3 and A, = 2. 


2. For each eigenvalue, find an eigenvector by converting the matrix AJ — A to reduced 
row-echelon form. 


Eigenvector 
IL =2 1 2 =. 
aaa) > [ool @ LG 
= 4 =2 Lo =g 1 
u-a-[ $ 2] > k ; > j] 


The eigenvectors (—2, 1) and (1, 2) form an orthogonal basis for R?. Normalize 
these eigenvectors to produce an orthonormal basis. 


-31-a=| 


p= poe =(-3 = p= i= (4 | 
(2, DI V5’ /5 > | 2 AS" VS 
3. Each eigenvalue has a multiplicity of 1, so go directly to step 4. 


4. Using p, and p, as column vectors, construct the matrix P. 


-2 l 
J5 V5 
D 1 2 


2 1 2 1 
Gos) a SX a a 0 
paee IL a a iTo al 

7s a S5 A5 | 
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EXAMPLE 9 Orthogonal Diagonalization 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


2 2 =2 
Find a matrix P that orthogonally diagonalizes A = 2 =] 4}. 
=2 4 -1 


SOLUTION 


1. The characteristic polynomial of A, |AJ — A| = (A + 6)(A — 3)?, yields the 
eigenvalues A, = —6 and A, = 3. The eigenvalue A, has a multiplicity of 1 and 
the eigenvalue À, has a multiplicity of 2. 


2. An eigenvector for A, is v, = (1, —2, 2), which normalizes to 


n vi (3 2 2) 
"(yl \3 337 
3. Two eigenvectors for À, are v, = (2, 1, 0) and v, = (—2, 0, 1). Note that v; is 
orthogonal to v, and v} by Theorem 7.9. The eigenvectors v, and v}, however, are 


not orthogonal to each other. To find two orthonormal eigenvectors for A, use the 
Gram-Schmidt process as shown below. 


w, = v, = (2, 1, 0) 


These vectors normalize to 


Wo 


> ped” (eve) 


R W3 (- 2 4 5 
> {Iw Bf 5 34/5 35/5) 


4. The matrix P has u,, u,, and u; as its column vectors. 


1 2 _ 2 
3 a5 35 
p= _2 1 4 
3 45 345 
2 
2 e 28s 
3 3/5 
—6 0 0 
A check shows that P™!AP = PTAP =| 0 3 0 
0 0 3 | 
LINEAR The Hessian matrix is a symmetric matrix that can be helpful 


in finding relative maxima and minima of functions of several 
ALGEBRA variables. For a function f of two variables x and y—that is, a 


APPLIED surface in R3—the Hessian matrix has the form 
h; fa 
fyx fy 


The determinant of this matrix, evaluated at a point for 
which f, and f, are zero, is the expression used in the 
Second Partials Test for relative extrema. 


Tacu Alexei/Shutterstock.com 
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7 3 Exercises See CalcChat.com for worked-out solutions to odd-numbered exercises. 


Chapter 7 Eigenvalues and Eigenvectors 


Determining Whether a Matrix Is Symmetric In 
Exercises 1 and 2, determine whether the matrix is 
symmetric. 


2 0 3 5 
4 -2 1 
0 ll 0 =2 
1. i 1 ; 2. 3 0 5 0 
>) eZ 0 1 


Proof In Exercises 3-6, prove that the symmetric 
matrix is diagonalizable. 


0 0 a 0 a 0 
3. A=1]0 a 0 4 A=ja 0 a 
a 0 0 0 a 0 
a 0 a 
5. A=]|0 a 0 6. A= a a 
a 0 a a 


Finding Eigenvalues and Dimensions of 
Eigenspaces In Exercises 7-18, find the eigenvalues 
of the symmetric matrix. For each eigenvalue, find the 
dimension of the corresponding eigenspace. 


n a 


3 0 0 E 
9/0 2 0 10/1 2 1 
0 0 2 i ft 3 
0 2 2 0 4 4 
1.|2 0 2 12.|4 2 0 
2 2 0 4 0 -2 
0 1 1 2 -1 -1 
13.|1 0 1 14. |-1 2 -1 
i 1 4 -1 -1 2 
3 0 0 0 -1 2 0 0 
0 3 0 0 2-1 0 0 
Ply ag a s l o gei g 
0 0 5 3 0 0 2-1 
2-1 0 0 0 
-1 2 0 0 0 
.| 0 0 2 0 0 
0 0 0 2 0 
0 0 0 0 2 
1-1 0 0 0 
-1 1 0 0 0 
.| 0 0 1 0 0 
0 0 0 1-1 
0 0 O-1 1 


Determining Whether a Matrix Is Orthogonal In 
Exercises 19-32, determine whether the matrix is 
orthogonal. If the matrix is orthogonal, then show that 
the column vectors of the matrix form an orthonormal set. 


v2 V2 4 4 
2 2 9 9 
19. BB 20. 43 
zo 9 9 
1 V3 
—0.936 —0.352 2 2 
2. | 0.352 ee a ave L 
2 32 
0 0 0 1 0 0 
23./0 1 0 24.0 1 0 
i 0 4 6 0 1 
2 2 
7 3 3 -4 o 2 
25.|$ 4 é 26.) 0 1 0 
AE -E 
-4 0 3 4 -1 -4 
27. 0 1 0 28. |-1 0 -17 
3 0 4 I1 4 -1 
v2.95 2 
2 6 3 
we §6 2/3 
2 6 3 
v2 4 «(5 
3 2 
30. 0 an 0 
2. ws 1 
6 5 2 
TER 
0 1 0 0 
a 0 0 1 0 
v7 0 0 3 
bV10 0 0 -/10 
0 0 1 0 
i 0 1 0 0 
3/10 0 0 A /10 
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Eigenvectors of a Symmetric Matrix In Exercises 
33-38, show that any two eigenvectors of the symmetric 
matrix corresponding to distinct eigenvalues are 
orthogonal. 


3 3 a <2 
a 3 u[7) 2] 
1 0 0 3 0 0 
35./0 1 0 36.0 -3 0 
0o 0 2 0 0 2 
0 J3 o0 i Ge i 
37.|/3 0 -1 38.10 1 0 
0-1 0 1 0 =] 


Orthogonally Diagonalizable Matrices In Exercises 
39-42, determine whether the matrix is orthogonally 
diagonalizable. 


3 2 =3 
39. f | 40.;-2 -1 2 
=3 2 3 
5-3 8 1 ot 0 
41. |=3 =3- =3 42. 0 -1 0 -1 
8 —3 8 


=1 0 =1 0 


Orthogonal Diagonalization In Exercises 43-52, find 
a matrix P such that P™AP orthogonally diagonalizes A. 
Verify that PTAP gives the correct diagonal form. 


eaf J ma Y 


2 4 
0O 1 1 
a ft 
sasl a 46.A=]1 0 1 
ik i 4 
0 10 10 0 3 0 
47. A=|10 5 O| 48A=/13 0 4 
10 O- 0 4 0 
i. =f 2 
49. A=|-— i 2 
2 2 2 
za 4 A 
50. A=| 2 -2 4 
4 4 4 
4 2 0 0 
2 4 0 0 
he 0 4 2 
0 0 2 4 
1 1 0 0 
1 i 0 0 
52. A=] E 4 
0 0 tf 1 


7.3 Exercises 377 


True or False? In Exercises 53 and 54, determine 
whether each statement is true or false. If a statement 
is true, give a reason or cite an appropriate statement 
from the text. If a statement is false, provide an example 
that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 
53. (a) Let A be an n x n matrix. Then A is symmetric if 
and only if A is orthogonally diagonalizable. 
(b) The eigenvectors corresponding to distinct 
eigenvalues are orthogonal for symmetric matrices. 
54. (a) A square matrix P is orthogonal when it is 
invertible—that is, when P~! = PT. 
(b) If A is an n x n symmetric matrix, then A has real 
eigenvalues. 


55. Proof Prove that if A and B are n x n orthogonal 
matrices, then AB and BA are orthogonal. 


56. Proof Prove that if a symmetric matrix A has only one 
eigenvalue A, then A = AI. 


57. Proof Prove that if A is an orthogonal matrix, then so 
are A? and A“!. 


58. CAPSTONE Consider the matrix below. 


=] 0 =] 0 1 
=] 0 
0 =1 
0 s=] 0 
1 =] 0 =]1 
(a) Is A symmetric? Explain. 
(b) Is A diagonalizable? Explain. 


(c) Are the eigenvalues of A real? Explain. 

(d) The eigenvalues of A are distinct. What are the 
dimensions of the corresponding eigenspaces? 
Explain. 

(e) Is A orthogonal? Explain. 

(f) For the eigenvalues of A, are the corresponding 
eigenvectors orthogonal? Explain. 


(g) Is A orthogonally diagonalizable? Explain. 


59. Proof Prove that the matrix below is orthogonal for 
any value of 0. 


cos? —sin@ 0 
sin 0 cosd 0 
0 0 1 
60. Find ATA and AA’ for the matrix below. What do you 
observe? 


1-3 2 
a=; —6 | 
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7.4 Applications of Eigenvalues and Eigenvectors 


REMARK 


Recall from Section 6.4 that the 
age transition matrix L is also 
called a Leslie matrix after 
mathematician Patrick H. Leslie. 


Model population growth using an age transition matrix and an 
age distribution vector, and find a stable age distribution vector. 


Use a matrix equation to solve a system of first-order linear 
differential equations. 


Find the matrix of a quadratic form and use the Principal Axes 
J Theorem to perform a rotation of axes for a conic and a 
quadric surface. 


Solve a constrained optimization problem. 


POPULATION GROWTH 


Matrices can be used to form models for population growth. The first step in this 
process is to group the population into age classes of equal duration. For example, if 
the maximum life span of a member is M years, then the n intervals below represent 
the age classes. 


M i 
0, = First age class 

n 
M 2M 
-a Second age class 
n n 

— 1)M 

[e-u m| nth age class 
n 


The age distribution vector x represents the number of population members in each 
age class, where 


X Number in first age class 

Xz Number in second age class 
x= . 

Xi Number in nth age class 


Over a period of M/n years, the probability that a member of the ith age class will 
survive to become a member of the (i + 1)th age class is p;, where 


Osp,s 1li=1,2,...,n-1. 
The average number of offspring produced by a member of the ith age class is b;, where 
0 <b,i=1,2,...,n. These numbers can be written in matrix form, as shown 
below. 
Dy Dy ers -Dir DY 
Pı 0 0 0 
L= Po 0 0 
0 U sre Pr 0 


Multiplying this age transition matrix by the age distribution vector for a specific time 
period produces the age distribution vector for the next time period. That is, 


LX; = Xj44- 


Example | illustrates this procedure. 
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REMARK 


In Example 1, verify that 
the rabbit population after 
2 years is 


168 
152 |. 
6 


xX, = LX, = 


Notice from the age distribution 
vectors X4, Xz, and x, that the 
percent of rabbits in each of 
the three age classes changes 
each year. To obtain a stable 
growth pattern, one in which 
the percent in each age class 
remains the same each year, 
the (n + 1)th age distribution 
vector must be a scalar 
multiple of the nth age 
distribution vector. That is, 
Xn+1 = Lx, = Ax,. Example 2 
shows how to solve this 
problem. 
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EXAMPLE 1 A Population Growth Model 


A population of rabbits has the characteristics below. 

a. Half of the rabbits survive their first year. Of those, half survive their second year. 
The maximum life span is 3 years. 

b. During the first year, the rabbits produce no offspring. The average number of 
offspring is 6 during the second year and 8 during the third year. 

The population now consists of 24 rabbits in the first age class, 24 in the second, 

and 20 in the third. How many rabbits will there be in each age class in 1 year? 


SOLUTION 


The current age distribution vector is 


24 0 < age < 1 
x, = | 24 lS age < 2 
20 2< age <3 


and the age transition matrix is 


0 6 8 
L=/05 0 0}. 
0 0.5 0 


After 1 year, the age distribution vector will be 


0 6 8]f24] [304 ican 
x,=Ix,=|05 0 offo4}=| 12 Lenes? 
0 o5  ol|20 12 Deas 29 ul 


EXAMPLE 2 Finding a Stable Age Distribution Vector 


Find a stable age distribution vector for the population in Example 1. 


SOLUTION 


To solve this problem, find an eigenvalue A and a corresponding eigenvector x such that 
Lx = Xx. The characteristic polynomial of L is 


a-ri = (A + 1) — 2) 


(check this), which implies that the eigenvalues are — 1 and 2. Choosing the positive 
value, let 4 = 2. Verify that the corresponding eigenvectors are of the form 


Xi 16t 16 
x Xz 4t t 
X3 t 1 


For example, if t = 2, then the initial age distribution vector is 


32 0 < age < 1 
x, =| 8 1 = age < 2 
2 2< age <3 


and the age distribution vector for the next year is 


0 6 8 || 32 64 0 < age < 1 
x, = Lx, =|05 0 O}} 8) =] 16). 1 < age < 2 
0 0.5 oj 2 4 2< age <3 


Notice that the ratio of the three age classes is still 16 : 4 : 1, and so the percent of 
the population in each age class remains the same. | 
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Chapter 7 Eigenvalues and Eigenvectors 


SYSTEMS OF LINEAR DIFFERENTIAL 
EQUATIONS (CALCULUS) 


A system of first-order linear differential equations has the form 


Vi = Yi F Y2 F> + F Oy, 
Y = Ay VY, + AY ++ + + + AayVy 
Vp = ani + an2Yy2 5 a AnnYn 
i : dy, 
where each y; is a function of t and y; = oe If you let 
yi yı ai ai ain 
y= Ya , y= Ya . and A= a21 “22 an 
Yn Yn any an2 oe Ann 


Solving a System of Linear 
Differential Equations 


Solve the system of linear differential equations. 


y = 4y 
X! = =) 
ys = 2y3 
SOLUTION 
From calculus, you know that the solution of the differential equation y’ = ky is 
y = Ce". 


So, the solution of the system is 
yı = Cie” 
y2 = Ce! 


y3 = Ce”. m 


The matrix form of the system of linear differential equations in Example 3 is 
y’ = Ay, or 


yy’ 4 0 Ofly, 
y,,|=|]0 -1 0} yl. 
y3’ 0 0 2 J03 


So, the coefficients of ¢ in the solutions y; = C,e* are the eigenvalues of the matrix A. 
If A is a diagonal matrix, then the solution of 


can be obtained immediately, as in Example 3. If A is not diagonal, then the solution 
requires more work. First, find a matrix P that diagonalizes A. Then, the change of 
variables y = Pw and y’ = Pw’ produces 


Pw' = y' = Ay = APw => w =P 'APw 


where P~'!AP is a diagonal matrix. Example 4 demonstrates this procedure. 


Copyright 2017 Cengage Learning. All Rights Reserved. May not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eBook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage Learning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


7.4 Applications of Eigenvalues and Eigenvectors 381 


Solving a System of Linear 
EXAMPLE 4 Differential Equations 


See LarsonLinearAlgebra.com for an interactive version of this type of example. 


To solve the system of linear differential equations 
yy = 3y, + 2y 
yz’ = 6, — 2 


3 


6 
are A, = —3 and À, = 5, and that the corresponding eigenvectors are p, = [1 —3]? 
and p, = [1 1]". Diagonalize A using the matrix P whose columns consist of p, and p, 


to obtain 
=3 O 
d P'AP = . 
| = | 0 | 


1 
1 1 4 7 
= -l= 
P E i a ; 


The system w' = P~!APw has the form below. 
z E se] ; wi = — 3w; 
W> O SILw, w = w, 


The solution of this system of equations is 


2 
first find a matrix P that diagonalizes A = | _ A Verify that the eigenvalues of A 


>= BIE 


w, = Cie* 
w, = Oe. 
To return to the original variables y, and y,, use the substitution y = Pw and write 
F a 
Y2 -3 ljlw, 
which implies that the solution is 
y= wtw= Ce*+ Oe” 
yy = —3w, + w, = —3C e7 + Ce”. m 
If A has eigenvalues with multiplicity greater than 1 or if A has complex 
eigenvalues, then the technique for solving the system must be modified. 


1. Eigenvalues with multiplicity greater than 1: The coefficient matrix of the system 


y — Yo. = | 0 i] 
; is A= ; 
n» = —4y, + 4y, SA 4 
The only eigenvalue of A is A = 2, and the solution of the system is 


y= Cie + Cie” 
yy = (2C, + Cy)e% + 2Cyt0" 


2. Complex eigenvalues: The coefficient matrix of the system 


Oe is aal “a 
yo © Ji 1 0 


The eigenvalues of A are 1, = i and A, = —i, and the solution of the system is 
y, = C,cost + C, sint 
y, = — C, cost + C; sint. 


Check these solutions by differentiating and substituting into the original systems of 
equations. 
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Figure 7.2 


[13x2 — 10xy + 13y2-72=0 


Figure 7.3 


QUADRATIC FORMS 


Eigenvalues and eigenvectors can be used to solve the rotation of axes problem 
introduced in Section 4.8. Recall that classifying the graph of the quadratic equation 


ax? + bxy + cy? + dx +ey+f=0 Quadratic equation 


is fairly straightforward as long as the equation has no xy-term (that is, b = 0). If 
the equation has an xy-term, however, then the classification is accomplished most 
easily by first performing a rotation of axes that eliminates the xy-term. The resulting 
equation (relative to the new x'y'-axes) will then be of the form 


a(x'? + c'(y'? + d'x' + ey’ +f’ =0. 


You will see that the coefficients a’ and c’ are eigenvalues of the matrix 


a lee seal 


The expression 
ax? + bxy + cy? Quadratic form 
is the quadratic form associated with the quadratic equation 
ax? + bxy + cy? + dx +ey+f=0 


and the matrix A is the matrix of the quadratic form. Note that the matrix A is 
symmetric. Moreover, the matrix A will be diagonal if and only if its corresponding 
quadratic form has no xy-term, as illustrated in Example 5. 


EXAMPLE 5 Finding the Matrix of the Quadratic Form 


Find the matrix of the quadratic form associated with each quadratic equation. 
a. 4x? + 9y? — 36 = 0 b. 13x? — 10xy + 13y? — 72 = 0 


SOLUTION 


a. a = 4,b = 0, andc = 9, so the matrix is 


4 0 i ; 
A= 0 of Diagonal matrix (no xy-term) 
b. a = 13,b = — 10, and c = 13, so the matrix is 
a| = Nondiagonal matrix (xy-term) 
-5 43} ondiagonal matrix (xy-term | 


In standard form, the equation 4x? + 9y? — 36 = 0 is 


2 y 
— +^ = 
3 2 ! 
which is the equation of the ellipse shown in Figure 7.2. Although it is not apparent 
by inspection, the graph of the equation 13x? — 10xy + 13y? — 72 = 0 is similar. 
In fact, when you rotate the x- and y-axes counterclockwise 45° to form a new 
x'y'-coordinate system, this equation takes the form 
wP O'P 
32 + 22 


=1 


(verify this) which is the equation of the ellipse shown in Figure 7.3. 
To see how to use the matrix of a quadratic form to perform a rotation of axes, let 


X=[x yF. 
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REMARK 


For brevity, the 1x1 matrices [f] 


and [ax? + bxy + cy? + ey + f] 
are not shown enclosed in 
brackets. 


REMARK 


Note that the matrix product 
[d e]PX' has the form 


(dcos 6 + esin @)x’ 
+ (—dsin 0 + ecos 0)y'. 
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Then the quadratic expression ax? + bxy + cy? + dx + ey + f can be written in 
matrix form as shown below. 


XTAX + [d e]X + f= [kx la |: + [d al" +f 


=a + by + cy? + dx t+ey+f 


If b = 0, then no rotation is necessary. But if b # 0, then use the fact that A is 
symmetric and apply Theorem 7.10 to conclude that there exists an orthogonal matrix 
P such that PTAP = D is diagonal. So, if you let 
PTX = X' = K 
then it follows that X = PX’, and XTAX = (PX')TA(PX') = (X')TPTAPX' = (X')™DX’. 
The choice of the matrix P must be made with care. P is orthogonal, so its 


determinant will be +1. It can be shown (see Exercise 67) that if P is chosen so that 
|P| = 1, then P will be of the form 


pics [e 0 —sin a 


sin 0 cos 0 


where 0 is the angle of rotation of the conic measured from the positive x-axis to the 
positive x'-axis. This leads to the Principal Axes Theorem. 


Principal Axes Theorem 


For a conic whose equation is ax? + bxy + cy? + dx + ey + f = 0, the rotation 
X = PX' eliminates the xy-term when P is an orthogonal matrix, with |P| = 1, 
that diagonalizes the matrix of the quadratic form A. That is, 


À 0 
T = 1 
P'AP | 0 4 


where A, and À, are eigenvalues of A. The equation of the rotated conic is 


AQ’)? + A,(y')? + [d e]PX' + f= 0. 


STARE Rotation of a Conic 


Perform a rotation of axes to eliminate the xy-term in the quadratic equation 


13x2 — 10xy + 13y? — 72 = 0. 


SOLUTION 
The matrix of the quadratic form associated with this equation is 
I3 =5 
A= i 
| =5 | 


The characteristic polynomial of A is (A — 8)(A — 18) (check this), so it follows that 
the eigenvalues of A are 1, = 8 and A, = 18. Then, the equation of the rotated conic is 


8(x')? + 18(y’)? — 72 = 0 
which, when written in the standard form 
1\2 1\2 
er OFL 


32 22 =A 


is the equation of an ellipse. (See Figure 7.3.) m 


Copyright 2017 Cengage Learning. All Rights Reserved. May not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eBook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage Learning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


384 


Chapter 7 Eigenvalues and Eigenvectors 


In Example 6, the eigenvectors of the matrix A are 


s[e eE 


which you can normalize to form the columns of P, as shown below. 


sin 0 cos 0 


1 
af 2 =| Bea 
t 
/2 


Note first that |P| = 1, which implies that P is a rotation. Moreover, 
cos 45° = 1//2 = sin 45°, so the angle of rotation is 45° as shown in Figure 7.3. 

The orthogonal matrix P specified in the Principal Axes Theorem is not unique. 
Its entries depend on the ordering of the eigenvalues A, and À, and on the subsequent 
choice of eigenvectors x, and x,. For instance, in the solution of Example 6, any of the 
choices of P shown below would have worked. 


1, =8,4, = 18 à, =18,4,=8 
0 = 225° @ = 135° 0 = 315° 


For any of these choices of P, the graph of the rotated conic will, of course, be the 
same. (See below.) 


The list below summarizes the steps used to apply the Principal Axes Theorem. 
1. Form the matrix A and find its eigenvalues 1, and A,. 


2. Find eigenvectors corresponding to 1, and 1,. Normalize these eigenvectors to 
form the columns of P. 


3. If |P| = —1, then multiply one of the columns of P by — 1 to obtain a matrix of 
the form 


p= E 0 —sin A 


~ Lsin@ cos @ 
4. The angle 0 represents the angle of rotation of the conic. 


5. The equation of the rotated conic is A,(x’)? + A,(y’)? + [d e]PX’ + f= 0. 
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Example 7 shows how to apply the Principal Axes Theorem to rotate a conic whose 
center is translated away from the origin. 


EXAMPLE Rotation of a Conic 


Perform a rotation of axes to eliminate the xy-term in the quadratic equation 
3x2 — 10xy + 3y? + 16./2x — 32 = 0. 
SOLUTION 


The matrix of the quadratic form associated with this equation is 


ass 3] 


The eigenvalues of A are 


A, =8 and A, = -2 


with corresponding eigenvectors of 
x, =(-1,1) and x, =(-1,-1). 


This implies that the matrix P is 


1 1 
A2 NA 
p= 
AE 
/2 wa 
cos@ —sin 0 
be cos A whens |P= I 


cos 135° = —1/,/2 and sin 135° = 1/,/2, so the angle of rotation is 135°. Finally, 
from the matrix product 


1 1 
[d e]Px’ =[16/2 0] n [o] 
Ve ae 
= — 16x’ — l6oy’ 
the equation of the rotated conic is 
8(x')? — 2(y')? — 16x’ — 16y' — 32 = 0. 
In standard form, the equation is 
ey w- G'+4P_, 
1° 2 12 22 
Figure 7.4 which is the equation of a hyperbola. Its graph is shown in Figure 7.4. m 


Quadratic forms can also be used to analyze equations of quadric surfaces in R?, 
which are the three-dimensional analogs of conic sections. The equation of a quadric 
surface in R? is a second-degree polynomial of the form 


ax? + by? + cz? + dxy + exz + fyz + gx thy +iz+j=0. 


There are six basic types of quadric surfaces: ellipsoids, hyperboloids of one 
sheet, hyperboloids of two sheets, elliptic cones, elliptic paraboloids, and hyperbolic 
paraboloids. The intersection of a surface with a plane, called the trace of the surface 
in the plane, is useful to help visualize the graph of the surface in R°. The six basic 
types of quadric surfaces, together with their traces, are shown on the next two pages. 
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Ellipsoid 


Z] 
-= 


2 2 
y 
aT ps 


Trace Plane 


Ellipse Parallel to xy-plane 
Ellipse Parallel to xz-plane 
Ellipse Parallel to yz-plane 


The surface is a sphere when 
a=b=c +0. 


Hyperboloid of One Sheet 


x2 y 


2 
e P e 


2 
Ži 


Trace Plane 


Ellipse Parallel to xy-plane 
Hyperbola Parallel to xz-plane 
Hyperbola Parallel to yz-plane 


The axis of the hyperboloid 
corresponds to the variable whose 
coefficient is negative. 


Hyperboloid of Two Sheets 


Ellipse Parallel to xy-plane 
Hyperbola Parallel to xz-plane 
Hyperbola Parallel to yz-plane 


parallel to 
xy-plane 


The axis of the hyperboloid 
corresponds to the variable whose 
coefficient is positive. There is 
no trace in the coordinate plane 
perpendicular to this axis. 
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Elliptic Cone 


Trace 


Ellipse Parallel to xy-plane 
Hyperbola Parallel to xz-plane 
Hyperbola Parallel to yz-plane 


The axis of the cone corresponds 
to the variable whose coefficient 
is negative. The traces in the 
coordinate planes parallel to this 
axis are intersecting lines. ye-trace 


Elliptic Paraboloid 


2=54+4 


2 
a b 


Trace Plane 


Ellipse Parallel to xy-plane 
Parabola Parallel to xz-plane 
Parabola Parallel to yz-plane parallel to 
xy-plane 


The axis of the paraboloid 
corresponds to the variable raised 


to the first power. i xy-trace 
(one point) 


Hyperbolic Paraboloid 


SS 


k> 
SIS 


Hyperbola Parallel to xy-plane 
Parabola Parallel to xz-plane 
Parabola Parallel to yz-plane 


ae 

= ae 

a 
rare 


a 


The axis of the paraboloid 
corresponds to the variable raised 
to the first power. 


parallel to 
xy-plane 
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REMARK 


In general, the matrix A of the 
quadratic form will always be 
symmetric. 


Figure 7.5 


The quadratic form of the equation 

ax? + by? + cz + dxy + exz + fyz + gx + hy +iz+j=0 Quadric surface 
is 

ax? + by? + cz + dxy + exz + fyz. Quadratic form 


The corresponding matrix is 


de 
ta a 
_|d f 
A=|5 b 5| 
e f 
22 f 


In its three-dimensional version, the Principal Axes Theorem relates the eigenvalues 
and eigenvectors of A to the equation of the rotated surface, as shown in Example 8. 


EXAMPLE 8 Rotation of a Quadric Surface 


Perform a rotation of axes to eliminate the xz-term in the quadratic equation 


5x? + 4y? + 52? + 8xz — 36 = 0. 


SOLUTION 
The matrix A associated with this quadratic equation is 
5 0 4 
A= /0 4 0 
4 0 5 


which has eigenvalues of A, = 1, A, = 4, and A, = 9 (verify this). So, in the rotated 

x'y'z’-system, the quadratic equation is (x’)? + 4(y’)? + 9(z’)? — 36 = 0, which in 

standard form is 
E OP, CF 
e tp rT 


The graph of this equation is an ellipsoid. As shown in Figure 7.5, the x'y'z'-axes 
represent a counterclockwise rotation of 45° about the y-axis. Verify that the columns of 


E S 
J2 2 
P= 0 1 0 
Luh, gd 


are the normalized eigenvectors of A, that P is orthogonal, and that PAP is diagonal. 


LINEAR Some of the world’s most unusual architecture makes use 
ALGEBRA of quadric surfaces. For example, Catedral Metropolitana 
Nossa Senhora Aparecida, a cathedral located in Brasilia, 
APPLIED Brazil, is in the shape of a hyperboloid of one sheet. It 
was designed by Pritzker Prize winning architect Oscar 
Niemeyer, and dedicated in 1970. The sixteen identical 
curved steel columns are intended to represent two hands 
reaching up to the sky. In the triangular gaps formed by the 
columns, semitransparent stained glass allows light inside 
for nearly the entire height of the columns. 


ostill/Shutterstock.com 
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CONSTRAINED OPTIMIZATION 


Many real-life applications require you to determine the maximum or minimum value 
of a quantity subject to a constraint. For instance, consider a simplified example in 
which you need to find the maximum and minimum values of the quadric surface 
f(x, y) = 9x? + 5y? along the curve formed by intersection of the surface with the 
unit cylinder x? + y? = 1, as shown in Figure 7.6. The constraint is the unit cylinder 
x? + y? = 1. By inspection, the maximum value of f is 9 when x = +1 and y = 0, and 
the minimum value of f is 5 when x = 0 and y = +1. 

The theorem below allows you to use the eigenvalues and eigenvectors of a 
symmetric matrix to solve a constrained optimization problem. 


Constrained Optimization Theorem 


Figure 7.6 For a quadratic form f in n variables with matrix of the quadratic form A subject 


to the constraint |x|? = 1, the maximum value of f is the greatest eigenvalue of 
A and the minimum value of f is the least eigenvalue of A. 


PROOF 
The quadratic form f can be written as 
fX. - <, Xp) = XTAx. 


The matrix of the quadratic form A is symmetric, so A has n real eigenvalues (counting 


multiplicities). Call these A,,A5,. . .A,, and assume that À; =A, 3>- 2A,. Now 
consider a change of variables x = Px’, where x’ = [x,’ x) .. . x] and P is an 
orthogonal matrix that diagonalizes A. Then 
Ff (%q,%,. - -, X,) = XTAX 
= (Px’)? A(Px') 
= (x’)’PTAPx' 
= Dla)? Ag )? ee ee ALP 
and 


kP = |[Px'|? 
= (Px’)"(Px’) 
= (x’)’PTPx' 
= (x) 
= (x,') + im Bde ee aE a 
= |x’[P. 


|x|? = 1, so |[x’|? = 1, and 


a, = Alle’? + P+ + GP 
z AEP + Aaa) +--+ + A, 0, 
= ALP + P+ + OP] 
= Àp 
This shows that à} = xTAx = 1, So, all values of f(x}, x3, . . . , X„) = x7Ax for which 
|x|? = 1 lie between J, and J,,. If x is a normalized eigenvector that corresponds to À, then 
fap X». -3 X) = XTAX = xT x) = Alile = A. 
If x is a normalized eigenvector that corresponds to J, then 
fO X». o -s Xp) = XTAx = xT(,x) = Alile = à, 
So, f has a constrained maximum of 1, and a constrained minimum of À. T 
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REMARK 


With the substitutions x = x, 
and y = x, this is the same 
problem as that given at the 
top of the preceding page. 


: EXAMPLE 9 , Finding Maximum and Minimum Values 


Find the maximum and minimum values of f(x,,x,) = 9x? + 5x3 subject to the 
constrait ||x||? = 1. 


SOLUTION 


The matrix of the quadratic form is the diagonal matrix 


9 0 
A= ; 
los 
By inspection, the eigenvalues of A are A, = 9 and A, = 5. So by the Constrained 
Optimization Theorem, the maximum value of z is 9 and the minimum value of z is 5. 


EXAMPLE 10 Finding Maximum and Minimum Values 


Find the maximum and minimum values, and the corresponding normalized 
eigenvectors, of z = 7x? + 6x,x, + 7x} subject to the costraint ||x||? = 1. 


SOLUTION 


The quadratic form f can be written using matrix notation as 


je Saas al; I 


7 
Verify that the eigenvalues of A = | 3 ‘| are; = 10andA, = 4, with corresponding 
eigenvectors 


i] e [l 


1 1 1 
So, the constrained maximum of 10 occurs when (x,, x5) ath 1) ( Va Jz) 


1 1 1 
and the constrained minimum of 4 occurs when (x4, x») = at 1ll= (- =, sr} 
2 DA 


EXAMPLE 11 Using a Change of Variables 


To find the maximum and minimum values of 


z = 4xy 


subject to the constraint 9x? + 4y? = 36, you cannot use the Constrained Optimization 
Theorem directly because the constraint is not ||x|? = 1. However, with the change of 
variables 


x=2x' and y= 3y’ 
the problem becomes finding the maximum and minimum values of 
z = 24x'y' 


subject to the constraint (x')? + (y’)? = 1. Verify that the maximum value of 12 occurs 
when (x’, y’) = (17/2, 1//2), or (x, y) = (2, 3/2), and the minimum value of 
— 12 occurs when (x', y’) = (1//2, —1/,/2), or (x, y) = (./2, —3/,/2). | 
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7 4 Exercises See CalcChat.com for worked-out solutions to odd-numbered exercises. 


Finding Age Distribution Vectors In Exercises 1-6, 
use the age transition matrix L and age distribution 
vector x, to find the age distribution vectors x, and x;. 
Then find a stable age distribution vector. 


a 


N 


7. 


t 

ll 
——1 
N= © 


2 r = |i 
op 10 


ral Ag - [16] 
=e se 
x o7 [160 
0 3 4 12 
L=|1 0 0ļx;=]12 
o ¿£ O 12 
0 2 0 8 
L=|} © olx =/8 
0 + 0 8 
0 2 2 0 100 
1 
1 0 0 0 100 
— 4 — 
E= 1 o OoP™ I 100 
0 0 4 0 100 
0 6 4 0 0 24 
3 0 0 0 0 24 
L=|0 ı © 0 O0ļx=]|24 
0 0 4 0 0 24 
0 0 0 4 0 24 
Population Growth Model A population has the 


characteristics below. 


(a) A total of 75% of the population survives the first 
year. Of that 75%, 25% survives the second year. 
The maximum life span is 3 years. 


(b) The average number of offspring for each member 
of the population is 2 the first year, 4 the second 
year, and 2 the third year. 


The population now consists of 160 members in each of 
the three age classes. How many members will there be 
in each age class in 1 year? in 2 years? 


. Population Growth Model A population has the 


characteristics below. 


(a) A total of 80% of the population survives the first 
year. Of that 80%, 25% survives the second year. 
The maximum life span is 3 years. 


(b) The average number of offspring for each member 
of the population is 3 the first year, 6 the second 
year, and 3 the third year. 


The population now consists of 120 members in each of 
the three age classes. How many members will there be 
in each age class in 1 year? in 2 years? 


9. Population Growth Model A population has the 
characteristics below. 


(a) A total of 60% of the population survives the first 
year. Of that 60%, 50% survives the second year. 
The maximum life span is 3 years. 


(b) The average number of offspring for each member 
of the population is 2 the first year, 5 the second 
year, and 2 the third year. 

The population now consists of 100 members in each of 

the three age classes. How many members will there be 

in each age class in 1 year? in 2 years? 
10. Find the limit (if it exists) of A"x, as n approaches 
infinity, where 


0 2 a 
A= f zl and x = [e] 


Solving a System of Linear Differential Equations In 
Exercises 11-20, solve the system of first-order linear 
differential equations. 


11. y,’ = 2y, 12. y,’ = —Sy, 
y2 = Vo yy = Ayo 

13. y’ = —4y, 14. y = W 
yy) = -52 yy = ae 

15. y’ = -y 16. y'= 5y 
y = by, yy’ = —2yy 
ys = Vs Ye = = 35 

17. y’ = —0.3y, 18. y,' = -by 
z= 0 4 = = 
ys = =0.6y; ys! = — By, 

19. y'= Wi 20. y' = —0.1y; 
ys = 9 yy = -m 
y = -y y3 = —2ny; 
vy = 9y, y = J 5y4 


Solving a System of Linear Differential Equations In 
Exercises 21-28, solve the system of first-order linear 
differential equations. 


21. y’ = y, — 4y, 22. y,’ = yi — 4y, 
J = 2y, X» = —2y, + 8y 
23. y = y + 2y 24. y,' = y- We 
yy) = 2y, + y ya’ = 2y, + 4y» 
25. yi =y — 2y2 + ys 26. y = 2y, +y +y 
X» = 2y, + Ay; y= Wty 
»' = 3y3 yy = Vy + y3 
27. y = 3y, — 5y; 28. y’ = —2y, + y 
ya’ = 4y, — 42 + 10y, » = 3y, + 43 
y3 = — Ay; y3 = Y3 
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Writing a System and Verifying the General Solution 
In Exercises 29-32, write the system of first-order 
linear differential equations represented by the matrix 
equation y’ = Ay. Then verify the general solution. 


A 1| y, = Cie’ + Cte" 
aah ifr oe 
30. A= | 4 yı = Ce cost + Ce sint 
1 1) ya = — Ce cost + Cæ sin t 
0 1 0 
31. A =|0 0 1}, 
0 -4 0 
y, =C, + C,cos2t+ C, sin 2t 
y = 2C, cos 2t — 2C, sin 2t 
y, =  — 4C, cos 2t — 4C; sin 2t 
0 1 0 
32. A =|0 0 1}, 
|. =='3 3 
y = Cie + Cte! + Cte! 
y= (Ci + C )e! + (C, + 203)te! + Cte! 


y, = (C, + 2C, + 2C,)e* + (C, + 4C,)te + Gre 


Finding the Matrix of a Quadratic Form In Exercises 
33-38, find the matrix A of the quadratic form associated 
with the equation. 


33. x7 + y?-4=0 34. x? — 4xy + yw —-4=0 
35. 9x2 + 10xy — 4y? — 36 = 0 

36. 12x2 = 5xy — x + 2y — 20 = 0 

37. 10xy — 10y? + 4x — 48 = 0 

38. 16x? — 4xy + 20y? — 72 =0 


Finding the Matrix of a Quadratic Form In Exercises 
39-44, find the matrix A of the quadratic form associated 
with the equation. Then find the eigenvalues of A and an 
orthogonal matrix P such that P7AP is diagonal. 


39. 2x? — 3xy — 2y? + 10 = 0 

40. 5x? — 2xy + 5y? + 10x — 17 = 0 

41. 13x2 + 6./3xy + Ty? — 16 =0 

42. 3x2 — 2\/3xy + y2? + 2x + 2\3y =0 

43. 16x? — 24xy + 9y? — 60x — 80y + 100 = 0 

44, 17x? + 32xy — Ty? — 75 =0 

Rotation of a Conic In Exercises 45-52, use the 
Principal Axes Theorem to perform a rotation of axes to 
eliminate the xy-term in the quadratic equation. Identify 


the resulting rotated conic and give its equation in the 
new coordinate system. 


45. 13x2 — 8xy + Ty? — 45 = 0 
46. x? + 4xy + yw? -9=0 

47. 2x? — 4xy + 5y? — 36 = 0 

48. 7x? + 32xy — 17y? — 50 = 0 


49. 2x? + 4xy + 2y? + 62x + 2,\/2y +4 =0 
50. 8x2 + 8xy + 8y2 + 10/2x + 26 /2y + 31 =0 
51. xy t+ x- 2y+3=0 

52. 5x2 — 2xy + Sy? + 10,\/2x = 0 


Rotation of a Quadric Surface In Exercises 53-56, 
find the matrix A of the quadratic form associated with 
the equation. Then find the equation of the quadric 


Foghat 


surface in the rotated x'y’z'-system. 

53. 3x7 — 2xy + 3y? + 82 — 16=0 

54, 2x? + 2y? + 277 + 2xy + 2xz + 2vz-1=0 

55. x? + 2y? + 222 + 2yvz-1=0 

56. x2 + y? +2 + 2xy-8=0 

Constrained Optimization In Exercises 57-66, find 


the maximum and minimum values, and a vector where 
each occurs, of the quadratic form subject to the constraint. 


57. z = 3x? + 2x3; |x|? = 1 

58. z = 11x2 + 4x2; |x = 1 

59. z = x? + 12x7; 4x? + 25x2 = 100 
60. z = —5x? + 9y?; x? + 92? = 9 

61. z = 5x? + 12xy + 5y% x? +y? = 1 
62. z = 5x? + 12x xz; x = 1 

63. z = 6x,x); xl =1 


64. z = Oxy; 9x2 + 16y? = 144 
65. w =x? + By? +z? + 2xy + 2xz + 2yz; x? +y? +2 = 1 
66. w = 2x? — y? — 22 + Axy At 8yz x? + y24+ 2= 


67. Let P be a 2 x 2 orthogonal matrix such that |P| = 1. 
Show that there exists a number 0,0 < 0 < 27, such that 


p= F 0 —sin | 


sin cos@ 


68. CAPSTONE 

(a) Explain how to model population growth using an 
age transition matrix and an age distribution vector, 
and how to find a stable age distribution vector. 


(b) Explain how to use a matrix equation to solve a 
system of first-order linear differential equations. 


(c) Explain how to use the Principal Axes Theorem to 
perform a rotation of axes for a conic and a quadric 
surface. 


(d) Explain how to solve a constrained optimization 
problem. 


69. Use your school’s library, the Internet, or some other 
reference source to find real-life applications of 
constrained optimization. 
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7 Review Exercises 


Review Exercises 393 


Characteristic Equation, Eigenvalues, and Basis In 
Exercises 1-6, find (a) the characteristic equation of A, 
(b) the eigenvalues of A, and (c) a basis for the eigenspace 
corresponding to each eigenvalue. 


2 1 3 4 
bis. | TR | 
9 4 -3 -4 i 2 
3.A4=|/-2 0 6| 4Aa=| 0 1 1 
-1 -4 ii 0 0 3 
2 0 1 1 0 4 
5 A=|0 3 4 6 A=|0 1 -2 
0 0 1 i: 0 -2 


BB Characteristic Equation, Eigenvalues, and Basis 


In Exercises 7 and 8, use a software program or a 
graphing utility to find (a) the characteristic equation of A, 
(b) the eigenvalues of A, and (c) a basis for the eigenspace 
corresponding to each eigenvalue. 


2 1 0 Q 3 0 2 0 
1 2 0 1 3 1 0 
BE 0 2 1 wami R S 
0 0 1 2 0 0 0 4 


Determining Whether a Matrix Is Diagonalizable In 
Exercises 9-14, determine whether A is diagonalizable. 
If it is, find a nonsingular matrix P such that P~'AP is 
diagonal. 


1 1 
_f{ 1 -4 _|o6 4 
nas| ii] wale | 

=2 =l 3 3 = 2 
11. A=] 0 1 2| 12. A=]-2 0 =i 

0 0 1 2. =l 
1 0 2 2 =l 1 
13. A =]|0 1 0 14. A= |-2 3 = 2 
2 0 1 =] 1 0 


15. For what value(s) of a does the matrix 


0 1 
A= 
E 
have the characteristics below? 
(a) A has an eigenvalue of multiplicity 2. 
(b) A has — 1 and 2 as eigenvalues. 


(c) A has real eigenvalues. 


16. Show that if 0 < 0 < 7, then the transformation for 
a counterclockwise rotation through an angle 0 has no 
real eigenvalues. 


Writing In Exercises 17—20, explain why the matrix is 
not diagonalizable. 
—1 2 
18. A = 
ol -i 


maz? 9 


0 0 

3 0 0 =) 3 1 
19, A=]1 3 0 20. A=] 0 4 3 

0 0 3 0 0 =2 


Determining Whether Two Matrices Are Similar In 
Exercises 21-24, determine whether the matrices are 
similar. If they are, find a matrix P such that A = P~'BP. 


1 0 2 0 
nafi Je- 9] 


5 0 T 2 
maf Je- 3 


1 1 0 1 1 0 
23. A =|0 1 1),B =/0 1 0 
0 0 1 0 0 1 
1 0 0 L S3 =3 
24.A=|0 -2 0|, B= 3 -=S S3 
0 0 -2 =3 3 1 


Determining Symmetric and Orthogonal Matrices In 
Exercises 25-32, determine whether the matrix is 
symmetric, orthogonal, both, or neither. 


_v2 v2 2/5 VS 
2 2 5 5 
| fe fa AT fe Bes 
2 2 5 5 
0 0 1 0 0 1 
27.A=|0 1 o| 2A=/0 1 
1 0 0 1 0 1 
1 1 1 4 3 
3 2 3 5 0 35 
2. 4=|} 0o 4| 3%a4=|0 ıı 0 
3 4 
S &@ -5 0 3 
—2 1 _2 
3 3 3 
2 2 1 
31. A=) 3 3 73 
1 _2 2 
3 3 3 


32. A= 


TETE 
N 
S 
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Eigenvectors of a Symmetric Matrix In Exercises 
33-36, show that any two eigenvectors of the 
symmetric matrix corresponding to distinct eigenvalues 
are orthogonal. 


2 0 4 -2 
33. [> _$] mh i] 

= 0 =l 2 0 0 
35. QO =1 0 36. | 0 2 0 

=i 0 1 0 0 5 


Orthogonally Diagonalizable Matrices In Exercises 
37-40, determine whether the matrix is orthogonally 
diagonalizable. 


-3 -1 
9. [23 2} 


4 1 2 5 4 -1 
39. |0 =1 0 40. 4 1 3 
2 J =5 =] 3 = 2 


Orthogonal Diagonalization In Exercises 41-46, find 
a matrix P that orthogonally diagonalizes A. Verify that 
PTAP gives the correct diagonal form. 


aa 4) aafe S 


4 -3 Id -=8 
1 1 0 3 0 -3 
43. A=]1 1 0 44. A=| 0 -3 0 
0 0 0 =3 0 3 
2 0 =1 1 2 0 
45.A=| 0 1 0| 46. A=]|2 1 0 
=] 0 2 0 0 5 


Steady State Probability Vector In Exercises 47-54, 
find the steady state probability vector for the matrix. 
An eigenvector v of an n x n matrix A is a steady state 
probability vector when Av = v and the components of 
v sum to 1. 


2 1 1 1 
47. A = f i 48. A = i | 
3 2 > 0 
0.8 03 04 0.2 
ea p | MAS p | 
2 
$ + 0 boj 
1 1 1 1 1 
51. A=]35 7 a 52. A=|35 3 0 
1 1 1 2 
Q 4 2 3 0 35 
0.7 01 0.1 0.3 0.1 04 
53. A=|0.2 0.7 01| 54.4=/02 04 0.0 
0.1 0.2 0.8 0.5 0.5 0.6 


55. Proof Prove that if A is an n x n symmetric matrix, 
then PTAP is symmetric for any n x n matrix P. 


56. Show that the characteristic polynomial of 


0 1 0 0 0 

0 0 1 0 0 
A= 

0 0 0 0 1 

ao di a a3 TAn=1 


is PHA + a A) tt et aA? rad +a. A 
is called the companion matrix of the polynomial p. 


Finding the Companion Matrix and Eigenvalues In 
Exercises 57 and 58, use the result of Exercise 56 to find 
the companion matrix A of the polynomial and find the 
eigenvalues of A. 


57. p(A) = 442 — 9A 
58. p(A) = 243 — 7A2 — 120A + 189 


59. The characteristic equation of 


“Ed 


is 47 — 101 + 24 = 0. Using A? — 10A + 241, = O, 
you can find powers of A by the process below. 

A? = 10A — 241,, A? = 10A? — 24A, 

At = 10A? — 24A?,... 


Use this process to find the matrices A”, A*, and A‘. 


60. Repeat Exercise 59 for the matrix 


9 4 -3 
A=|-2 0 6]. 
=] -4 H 


61. Proof Let A be ann x n matrix. 

(a) Prove or disprove that an eigenvector of A is also an 
eigenvector of A”. 

(b) Prove or disprove that an eigenvector of A? is also 
an eigenvector of A. 

62. Proof LetAbeann x n matrix. Prove thatif Ax = Ax, 
then x is an eigenvector of (A + cI), where À and c are 
scalars. What is the corresponding eigenvalue? 

63. Proof Let A and B ben x n matrices. Prove that if A 
is nonsingular, then AB is similar to BA. 


64. (a) Find a symmetric matrix B such that B? = A for 
2 1 
A= : 
i al 
(b) Generalize the result of part (a) by proving that if 
A is an nxn symmetric matrix with positive 


eigenvalues, then there exists a symmetric matrix B 
such that B? = A. 


65. Determine all n x n symmetric matrices that have 0 as 
their only eigenvalue. 
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66. Find an orthogonal matrix P such that P~'AP is 
diagonal for the matrix 


a b 
A= : 
f A 
67. Writing Let A be ann x n idempotent matrix (that is, 


A? = A). Describe the eigenvalues of A. 


68. Writing The matrix below has an eigenvalue A = 2 of 
multiplicity 4. 


2 a 0 0 
0 2 b 0 
a= 0 2 c 


0 0 0 2 


(a) Under what conditions is A diagonalizable? 


(b) Under what conditions does the eigenspace of 
A = 2 have dimension 1? 2? 3? 


True or False? In Exercises 69 and 70, determine 
whether each statement is true or false. If a statement 
is true, give a reason or cite an appropriate statement 
from the text. If a statement is false, provide an example 
that shows the statement is not true in all cases or cite an 
appropriate statement from the text. 


69. (a) An eigenvector of an n x n matrix A is a nonzero 
vector x in R” such that Ax is a scalar multiple of x. 


(b) Similar matrices may or may not have the same 
eigenvalues. 


(c) To diagonalize a square matrix A, you need to find 
an invertible matrix P such that P~!AP is diagonal. 


70. (a) An eigenvalue of a matrix A is a scalar À such that 
det(AJ — A) = 0. 
(b) An eigenvector may be the zero vector 0. 


(c) A matrix A is orthogonally diagonalizable when 
there exists an orthogonal matrix P such that 
P~'!AP = Dis diagonal. 


Finding Age Distribution Vectors In Exercises 71-74, 
use the age transition matrix L and the age distribution 
vector x, to find the age distribution vectors x, and x;. 
Then find a stable age distribution vector. 


0 1 100 
— |? ah E pA 


0 1 32 
G |; ob i H 

0 3 12 300 
73. L=|1 0 O|,x, =|300 

o 4 6 300 

0 2 2 240 
74. L=|} 0  O|,x, =| 240 

0 0 0 240 


Review Exercises 395 


75. Population Growth Model A population has the 
characteristics below. 


(a) A total of 90% of the population survives the first 
year. Of that 90%, 75% survives the second year. 
The maximun life span is 3 years. 


(b) The average number of offspring for each member 
of the population is 4 the first year, 6 the second 
year, and 2 the third year. 


The population now consists of 120 members in each of 
the three age classes. How many members will there be 
in each age class in 1 year? in 2 years? 


76. Population Growth Model A population has the 
characteristics below. 


(a) A total of 75% of the population survives the first 
year. Of that 75%, 60% survives the second year. 
The maximun life span is 3 years. 


(b) The average number of offspring for each member 
of the population is 4 the first year, 8 the second 
year, and 2 the third year. 


The population now consists of 120 members in each of 
the three age classes. How many members will there be 
in each age class in 1 year? in 2 years? 


Solving a System of Linear Differential Equations In 
Exercises 77-80, solve the system of first-order linear 
differential equations. 


77. y = 3y; 78. y = y2 
Yo = W- Ve Yo =J 

79. y = 3y; 80. y,' = 6y, — y + 2y3 
yy’ = 8y, X» = 3y2 — 3 
Ys = —Bys y = Ys 


Rotation of a Conic In Exercises 81-84, (a) find the 
matrix A of the quadratic form associated with the 
equation, (b) find an orthogonal matrix P such that 
PTAP is diagonal, (c) use the Principal Axes Theorem to 
perform a rotation of axes to eliminate the xy-term in 
the quadratic equation, and (d) sketch the graph of 
each equation. 

81. x? + 3xy + yw -—3 =0 

82. x2 — \/3xy + 2y? — 10 =0 
83. xy —-2=0 

84. 9x? — 24xy + 16y? — 400x 


300y = 0 


Constrained Optimization In Exercises 85-88, find 
the maximum and minimum values, and a vector where 
each occurs, of the quadratic form subject to the constraint. 


85. z = x? -—yyx27+y=1 

86. z = xx; 25x? + 4x? = 100 

87. z = 15x2- 4x x + 15x3 |x| = 1 

88. z = — 11x? + 10xy — 11y3; x? +y? = 1 
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7 Projects 


1 Population Growth and Dynamical Systems (I) 


Systems of differential equations often arise in biological applications of population 
growth of various species of animals. These equations are called dynamical systems 
because they describe the changes in a system as functions of time. Assume that a 
biologist studies the populations of predator sharks y,(t) and their small fish prey y(t) 
over time ¢. One model for the relative growths of these populations is 


a, yı (t) = ay,(d) + by,(t) Predator 
y2 (t) = cy, (4) + dy,(2) Prey 


where a, b, c, and d are constants. The constants a and d are positive, reflecting 
the growth rates of the species. In a predator-prey relationship, b > 0 andc < 0 
because an increase in prey fish y, would cause an increase in predator sharks y,, 
whereas an increase in y, would cause a decrease in y,. 


The system of linear differential equations below models the populations of 
sharks y(t) and prey fish y(t) with the populations at time t = 0. 
yA) =  0.5y,(4) + 0.6y,(2) y,(0) = 36 
yo’ (t) = —0.4y,(#) + 3.0y,(2) y,(0) = 121 
1. Use the diagonalization techniques of this chapter to find the populations y,(¢) and 
y(t) at any time t > 0. 


2. Interpret the solutions in terms of the long-term population trends for the two 
species. Does one species ultimately disappear? Why or why not? 


3. Graph the solutions y,(¢) and y,(t) over the domain 0 < ¢ < 3. 
4. Explain why the quotient y,(t)/y,(¢) approaches a limit as f increases. 


2 The Fibonacci Sequence 


7 The Fibonacci sequence is named after the Italian mathematician Leonard 
— tS) Fibonacci of Pisa (1170-1250). To form this sequence, define the first two terms 
as x, = 1 and x, = 1, and then define the nth term as the sum of its two immediate 
predecessors. That is, x, =x, , + xX, —>. So, the third term is 2 = 1 + 1. the 
fourth term is 3 = 2 + 1, and so on. The formula x, = x,_, + x,_, is called 
recursive because the first — 1 terms must be calculated before the nth term can be 
calculated. In this project, you will use eigenvalues and diagonalization to derive an 
explicit formula for the nth term of the Fibonacci sequence. 


1. Calculate the first 12 terms of the Fibonacci sequence. 


REMARK 1. i + 
2. Explain how the matrix identity | le | = ee | can be used 
You can learn more about M Obll|Lse eer 
dynamical systems and to generate the Fibonacci sequence recursively. 


population modeling in most 


books on differential equations. . Starting with | = k BOn AL a] = | | wie ace F I 
You can learn more about X if 1 all i © 


Fibonacci numbers in most 
books on number theory. 


w 


4. Find a matrix P that diagonalizes A. 


You might find it interesting to 5. Derive an explicit formula for the nth term of the Fibonacci sequence. Use this 
look at the Fibonacci Quarterly, formula to calculate x,, x,, and x3. 

the official journal of the 

Fibonacci Association. 6. Determine the limit of x,,/x,,_; as n approaches infinity. Do you recognize this 


number? 


Roger Jegg - Fotodesign-Jegg.de/Shutterstock.com 
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Cumulative Test for Chapters 6 and 7 397 


Se 
6 and 7 Cumulative Test Jegeg euge ous = 


Take this test to review the material in Chapters 6 and 7. After you are finished, 
check your work against the answers in the back of the book. 


In Exercises 1 and 2, determine whether the function is a linear transformation. 
1. T: RÈ > R?, T(x, y, z) = (2x, x + y) 2. T: M,,>R, T(A) = |A + A?| 


3. Let T: R” > R” be the linear transformation defined by T(v) = Av, where 


3 0 1 0 
a=[> a ok 


Find the dimensions of R” and R”. 


4. Let T: R? > F? be the linear transformation defined by T(v) = Av, where 


=2 0 
A= 1 0}. 
0 0 


Find (a) T(2, — 1) and (b) the preimage of (— 6, 3, 0). 
5. Find the kernel of the linear transformation 
TE R= RA Ti, to teeta) = Coy Rey Re = wy Oke Ea: 


6. Let T: R — R? be the linear transformation defined by T(v) = Av, where 


1 0 1 0 
am k -1 0 - l 
Find a basis for (a) the kernel of T and (b) the range of T. (c) Determine the rank 
and nullity of T. 


In Exercises 7-10, find the standard matrix for the linear transformation T. 

7. T(x, y) = Bx + 2y, 2y — x) 8. Tix, yz) = @ + y,y + zx- 2) 
9. T(x, y,z) = (3z — 2y, 4x + 11z) 10. T(x, x, x3) = (0, 0, 0) 

11. Find the standard matrix A for the linear transformation projju: R?—> R? that 


projects an arbitrary vector u onto the vector v = [1 —1]", as shown in the figure. 
Use this matrix to find the images of the vectors (1, 1) and (— 2, 2). 


12. Let T: R? > R? be the linear transformation defined by a counterclockwise rotation 
of 30° in R?. 
(a) Find the standard matrix A for the linear transformation. 
(b) Use A to find the image of the vector v = (1, 2). 
(c) Sketch the graph of v and its image. 


Figure for 11 


In Exercises 13 and 14, find the standard matrices for T = T, > T; and T’ = T; ° T}. 
13. 7,: R? > R?, T,(x, y) = (x — 2y, 2x + 3y) 
Ty: R? > R, T,(x, y) = (2x, x — y) 
14. Ti: RÈ > R?, T,(x, y, z) = (x + 2y,y — z, —2x + y + 2z) 
T,: RÈ > RÈ, T,(x, y, z) = (y + z,x + z, 2y — 2z) 
15. Find the inverse of the linear transformation T:R?—R? defined by 
T(x, y) = (x — y, 2x + y). Verify that (T7! o T)(3, —2) = (3, — 2). 


16. Determine whether the linear transformation T:R3—R? defined by 
T (x1, X2, X3) = (x; + X3, xX) + x3, X} + x3) is invertible. If it is, find its inverse. 
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17. Find the matrix of the linear transformation T(x, y) = i y, 2x, x + y) relative to 
the bases B = {(1, 1), (1, 0)} for R? and B’ = {(1, 0, 0), (1, 1, 0), (1, 1, 1)} for R°. 
Use this matrix to find the image of the vector (0, 1). 


18. Let B = {(1, 0), (0, 1)} and B’ = {(1, 1), (1, 2)} be bases for R?. 


(a) Find the matrix A of T: RR —>R?, T(x, y) = (x — 2y, x + 4y), relative to the 
basis B. 


(b) Find the transition matrix P from B’ to B. 
(c) Find the matrix A’ of T relative to the basis B’. 


(d) Find [7(v)],, when [v]; = E 


(e) Verify your answer in part (d) by finding [v]; and [T(v)]}- 


In Exercises 19-22, find the eigenvalues and the corresponding eigenvectors of 
the matrix. 


7 2 =I5 =5 
HEEE w [75 5] 
1 2 1 E =] 1 
21. |0 3 1 22. | 0 1 2 
0 =3 =] 0 0 1 


In Exercises 23 and 24, find a nonsingular matrix P such that P—'AP is diagonal. 


2 3 1 O. 33 5 
23. A=|0 -1 2 24. A=|-4 4 -10 
0 0 3 0 0 4 


25. Find a basis B for R? such that the matrix for the linear transformation 
T: R? > R?, T(x, y, z) = (2x — 2z, 2y — 2z, 3x — 3z), relative to B is diagonal. 


26. Find an orthogonal matrix P such that PAP diagonalizes the symmetric matrix 


=f ih 


27. Use the Gram-Schmidt orthonormalization process to find an orthogonal matrix P 
such that PAP diagonalizes the symmetric matrix 


0 2 2 
A= |2 0 2 |. 
2 2 0 


28. Solve the system of differential equations. 
Ji T YN 
y: = Wo 

29. Find the matrix of the quadratic form associated with the quadratic equation 
3x? — 16xy + 3y? — 13 = 0. 

30. A population has the following characteristics. 


(a) A total of 80% of the population survives the first year. Of that 80%, 
40% survives the second year. The maximum life span is 3 years. 


(b) The average number of offspring for each member of the population is 3 the 
first year, 6 the second year, and 3 the third year. 


The population now consists of 150 members in each of the three age classes. How 
many members will there be in each age class in | year? in 2 years? 


31. Define an orthogonal matrix. 


32. Prove that if A is similar to B and A is diagonalizable, then B is diagonalizable. 
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Appendix Mathematical Induction and Other Forms of Proofs 


Use the Principle of Mathematical Induction to prove statements 
involving a positive integer n. 


Prove by contradiction that a mathematical statement is true. 


Use a counterexample to show that a mathematical statement 
is false. 


MATHEMATICAL INDUCTION 


In this appendix, you will study some basic strategies for writing mathematical 
proofs—mathematical induction, proof by contradiction, and the use of counterexamples. 
Example | illustrates the logical need for using mathematical induction. 


EXAMPLE 1 Sum of Odd Integers 


Use the pattern to propose a formula for the sum of the first n odd integers. 


i= 
1+3=4 
1+3+5=9 


1+3+5+7=16 
1+3+5+7+9=25 


SOLUTION 


Notice that the sums on the right are equal to the squares 17, 27, 37, 4°, and 5?. From 
this pattern, it appears that the sum S, of the first n odd integers is 


S.H1+3 +35 47 40+ +4Qa = 1) =n. Ll 


Although this particular formula is valid, it is important for you to see that 
recognizing a pattern and then simply jumping to the conclusion that the pattern must 
be true for all values of n is not a logically valid method of proof. There are many 
examples in which a pattern appears to be developing for small values of n and then at 
some point the pattern fails. One of the most famous cases of this was the conjecture 
by the French mathematician Pierre de Fermat (1601-1665), who speculated that all 
numbers of the form 


Fi=2" +1, n=0,1,2,... 
are prime. For n = 0, 1, 2, 3, and 4, the conjecture is true. 
Fy =3 F,=5 F,=17 F; = 257 F, = 65,537 
The size of the next Fermat number (F; = 4,294,967,297) is so great that it was 


difficult for Fermat to determine whether it was prime or not. However, another 
well-known mathematician, Leonhard Euler (1707—1783), later found the factorization 


F, = 4,294,967,297 = (641)(6,700,417) 


which proved that F, is not prime and Fermat’s conjecture was false. 

Just because a rule, pattern, or formula seems to work for several values of n, 
you cannot simply decide that it is valid for all values of n without going through a 
legitimate proof. One legitimate method of proof for such conjectures is the Principle 
of Mathematical Induction. 
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A2 Appendix Mathematical Induction and Other Forms of Proofs 


The Principle of Mathematical Induction 


Let P, be a statement involving the positive integer n. If 


1. P, is true, and 
2. for every positive integer k, the truth of P, implies the truth of P,, ; 


then the statement P, must be true for all positive integers n. 


The next example uses the Principle of Mathematical Induction to prove the 
conjecture from Example 1. 


EXAMPLE 2 Using Mathematical Induction 


Use mathematical induction to prove the formula below. 
S,=14+34+5+7+---+(Qn-1)=nr 
SOLUTION 


Mathematical induction consists of two distinct parts. First, you must show that the 
formula is true when n = 1. 


1. When n = 1, the formula is valid because S$, = 1 = 12. 


The second part of mathematical induction has two steps. The first step is to 
assume that the formula is valid for some integer k (the induction hypothesis). 
The second step is to use this assumption to prove that the formula is valid for the 
next integer, k + 1. 


2. Assuming that the formula 
S=1+3+5+7+..--+(2k-1)= k 
is true, you must show that the formula S,, , = (k + 1)? is true. 


Sp eS laa eT eee OS 1) eRe 1) = 1] 
=[1+3+5+7+:;--+(2k-1)]+(2k+2- 1) 


= S, + (2k + 1) Group terms to form S, 
=k +2k+1 Substitute k? for S,. 
=(k+ 1) 


Combining the results of parts (1) and (2), you can conclude by mathematical induction 
that the formula is valid for all positive integers n. ai 


A well-known illustration used to explain why the Principle of Mathematical 
Induction works is the unending line of dominoes shown in Figure A.1. If the line 
contains infinitely many dominoes, then it is clear that you could not knock down the 
entire line by knocking down only one domino at a time. However, if it were true that 
each domino would knock down the next one as it fell, then you could knock them all 
Figure A.1 down simply by pushing the first one and starting a chain reaction. 

Mathematical induction works in the same way. If the truth of P, implies the truth 
of P,,; and if P, is true, then the chain reaction proceeds as shown below: 


P, implies P, 
P, implies P} 
P, implies P,, and so on. 


In the next example, you will see the proof of a formula that is often used in 
calculus. 
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Appendix Mathematical Induction and Other Forms of Proofs A3 


EXAMPLE 3 Using Mathematical Induction 


Use mathematical induction to prove the formula for the sum of the first n squares. 


n(n + 1)(2n + 1) 
6 


S,=2+224+327+44+-.-+n= 


SOLUTION 


1. When n = 1, the formula is valid, because 


1(1 + DRA +1] 196) 
6 — 6 


== 1. 


2. Assuming the formula is true for k, 


k(k + 1)(2k + 1) 
7 6 


S,=12+22?+37+4+---+8% 


you must show that it is true for k + 1, 


$= (k+ IL + 1) + 122K + 1)4+ 1) (k+ 1K + 2)(2k + 3) 
k+1 6 6 è 


To do this, write S,,; as the sum of S, and the (k + 1)st term, (k + 1}. 
Sing = (2 2+3 ++E+. -e k+ 


+ + 
= MA nok 1 + (k + 1)? Induction hypothesis 
(k + 1)(2k? + 7k + 6) Combine fractions 
— 6 and simplify. 
(k + 1)(k + 2)(2k + 3) pews 
= 6 S, implies S,,4. 


Combining the results of parts (1) and (2), you can conclude by mathematical induction 
that the formula is valid for all positive integers n. | 


Many of the proofs in linear algebra use mathematical induction. Here is an 
example from Chapter 2. 


"| Using Mathematical Induction 
EXAMPLE 4 in Linear Algebra 


IfA,,A,, . . .,A, are invertible matrices, then prove the generalization of Theorem 2.9. 
(A\A,A3° + A,)>' = Apts + + A3 A AT! 
SOLUTION 


1. The formula is valid trivially when n = 1 because Ay! = Aj}. 


2. Assuming the formula is valid for k, (A,;A,A,- - +A)! = Ag} + -A343 'AŢ!, 
you must show that it is valid for k + 1. To do this, use Theorem 2.9, which states 
that the inverse of a product of two invertible matrices is the product of their 
inverses in reverse order. 

(4,4,4; - . *ApAn 1)! = [(4,4,4; : ' “AJA 
= A} (A4,A3 < °A)! Theorem 2.9 
= Api (Az 1... -A3 YAS IA 1) Induction hypothesis 
= A4 Az! > © < A3 !AZ IAT! S, implies Sọ 1- 


Combining the results of parts (1) and (2), you can conclude by mathematical induction 
that the formula is valid for all positive integers n. 
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A4 


Appendix Mathematical Induction and Other Forms of Proofs 


PROOF BY CONTRADICTION 


Another basic strategy for writing a proof is proof by contradiction. In mathematical 
logic, you describe proof by contradiction by the equivalence below. 


p implies q if and only if not q implies not p. 


One way to prove that q is a true statement is to assume that q is not true. If this leads 
you to a statement that you know is false, then you have proved that q must be true. 
Example 5 shows how to use proof by contradiction to prove that J2 is irrational. 


EXAMPLE 5 Using Proof by Contradiction 


Prove that yI is an irrational number. 


SOLUTION 


Begin by assuming that \/2 is not an irrational number. Then \/2 is rational and can 
be written as the quotient of two integers a and b (b # 0) that have no common factors. 


a 
af = A Assume that ./2 is a rational number. 
2b? = a? Square each side and multiply by b?. 


This implies that 2 is a factor of a”. So, 2 is also a factor of a. Let a = 2c. 


2b? = (2c)? Substitute 2c for a. 
b? = 2c? Simplify and divide each side by 2. 


This implies that 2 is a factor of b?, and it is also a factor of b. So, 2 is a factor of 
both a and b. But this is impossible because a and b have no common factors. It 
must be impossible that /2 is a rational number. You can conclude that me is an 
irrational number. | 


EXAMPLE 6 Using Proof by Contradiction 


An integer greater than 1 is prime when its only positive factors are 1 and itself and 
composite when it has at least one other factor that is prime. Prove that there are 
infinitely many prime numbers. 


SOLUTION 
Assume there are only finitely many prime numbers, p,, P>,- . .,p,, Consider the 
number N = p; p2: > <P, + 1. This number is either prime or composite. N is not prime 
because N # p,. But, N is not composite because none of the primes (p,,P3,. - -> Pa) 
divide evenly into N. This is a contradiction, so the assumption is false. 

It follows that there are infinitely many prime numbers. m 


You can use proof by contradiction to prove many theorems in linear algebra. 


EXAMPLE 7 Using Proof by Contradiction in Linear Algebra 


Let A and B be n x n matrices such that AB is singular. Prove that either A or B is 
singular. 


SOLUTION 


Assume that neither A nor B is singular. You know that a matrix is singular if and only 
if its determinant is zero, so det(A) and det(B) are both nonzero real numbers. By 
Theorem 3.5, det(AB) = det(A) det(B). So, det(AB) is not zero because it is a product 
of two nonzero real numbers. But this contradicts that AB is a singular matrix. So, you 
can conclude that the assumption was wrong and that either A or B is singular. | 
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Appendix Mathematical Induction and Other Forms of Proofs A5 


USING COUNTEREXAMPLES 


Often you can disprove a statement using a counterexample. For instance, when 
Euler disproved Fermat’s conjecture about prime numbers of the form F, = 2” + 1, 
n=0,1,2,..., he used the counterexample F, = 4,294,967,297, which is 
not prime. 


EXAMPLE 8 j Using a Counterexample 


Use a counterexample to show that the statement is false. 


Every odd number is prime. 


SOLUTION 


Certainly, you can list many odd numbers that are prime (3, 5, 7, 11), but the statement 
above is not true, because 9 is odd but it is not a prime number. The number 9 is a 
counterexample. | 


Counterexamples can be used to disprove statements in linear algebra, as shown 
in the next two examples. 


EXAMPLE 9 Using a Counterexample in Linear Algebra 


Use a counterexample to show that the statement is false. 


If A and B are square singular matrices of order n, then A + B is a singular 
matrix of order n. 


SOLUTION 
1 0 0 0 ; 
Let A = 0 0 and B = o it Both A and B are singular of order 2, but 
1 0 
+ = 
Ate=[) 9 
is the identity matrix of order 2, which is not singular. ui 


DON" RSet Using a Counterexample in Linear Algebra 


Use a counterexample to show that the statement is false. 
The set of all 2 x 2 matrices of the form 
1 b 
| d 
with the standard operations is a vector space. 


SOLUTION 


To show that this set of matrices is not a vector space, let 


1 2 1 5 
a=[) A and si | 


REMARK 
. Both A and B are of the stated form, but the sum of these matrices, 

Recall that in order for a set 

to be a vector space, it must A _ {2 7 

satisfy each of the ten axioms a 9 11 

in the definition of a vector 

space. (See Section 4.2.) is not. This means that the set does not have closure under addition, so it does not 
satisfy the first axiom in the definition. | 
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A6 Appendix Mathematical Induction and Other Forms of Proofs 


Using Mathematical Induction In Exercises 1—4, use 
mathematical induction to prove the formula for every 
positive integer n. 


+ 
L1+2434---4n= Mt) 1 
2 B+ Be Bee. p Tr 
` 4 


3.3+7+11+-- -+ (4n- 1) =n(2n +1) 


See ee eee eee 


Proposing a Formula and Using Mathematical 
Induction In Exercises 5 and 6, propose a formula for 
the sum of the first n terms of the sequence. Then use 
mathematical induction to prove the formula. 


5. 212,07 6. 


Using Mathematical Induction In Exercises 7-14, use 
mathematical induction to prove the statement. 


Ten! > 2", n24 
DG ee ey 
a ae. ae 


9. For all integers n > 0, 


8. 


J — qt} 
O+tadt+at-+-+ar= i , a*l 
= 4 
10. If x; # 0, x, #0,...,x, #0, then 
Ganse ny Sa a aao ee h 


11. (From Chapter 2) If A is an invertible matrix and k is a 
positive integer, then 


(A) 1 = AIA: e ATT =A 1)k 
ee 


k factors 


12. (From Chapter 2) (A,A,A;° © -A,)? = AT- - - ATATAT, 
assuming that A,, Aj, A3,. . .,A, are matrices with 
sizes such that the multiplications are defined. 


13. (From Chapter 3) 
|4434; : ~~ A| = A,||45]/A3|° > JA 
where A,, A,, A3, . 
same order. 


14. (From Chapter 6) If the standard matrices of the 
linear transformations T,, T>, T3,. . ., T, are A}, A», 
A;,...,A, respectively, then the standard matrix for 
the composition 


T(v) = TAT ss _ : (T;(T,(T,(v)))) - +5) 
is A = A,A -1° © + A3A,A). 


nl 


. .,A, are square matrices of the 


Using Proof by Contradiction In Exercises 15-26, use 

proof by contradiction to prove the statement. 

15. If p is an integer and p° is odd, then p is odd. (Hint: 
An odd number can be written as 2n + 1, where n is 
an integer.) 

16. If p is a positive integer and p° is divisible by 2, then p 
is divisible by 2. 

17. If a and b are real numbers and a < b, then 
atc b+e. 


j 


8. If a, b, and c are real numbers such that ac = bc and 
c > 0, thena = b. 
19. If a and b are real numbers and 1 < a < b, then 
al >p 
20. If a and b are real numbers and (a + b)? = a? + b?, 
thena = Oorb=Oora=b=0. 
21. If ais areal number and 0 < a < 1, thena? < a. 


22. The sum of a rational number and an irrational number 
is irrational. 


23. (From Chapter 3) If A and B are square matrices of 
order n such that det(AB) = 1, then both A and B are 
nonsingular. 


24. (From Chapter 4) In a vector space, the zero vector is 
unique. 


25. (From Chapter 4) Let S = {u,v} be a linearly 
independent set. Prove that the set {u — v,u + v} is 
linearly independent. 


26. (From Chapter 5) Let $ = {x,, X2, . . ., X„} be a linearly 
independent set. Prove that if a vector y is not in 
span(S), then the set $} = {X,,%5,. . .,X,, y}is linearly 
independent. 


Using a Counterexample In Exercises 27-33, use a 
counterexample to show that the statement is false. 


27. If a and b are real numbers and a < b, then a? < Db’. 
28. The product of two irrational numbers is irrational. 
29. If f is a polynomial function and f(a) = f(b), thena = b. 


30. If f and g are differentiable functions and y = f(x)g(x), 
then y’ = f’(x)g’(x). 
31. The set of all 2 x 2 matrices of the form 


o al 
b 2 
with the standard operations is a vector space. 
32. T:R >R, T(x,,x,) = (x, + 4,x,) is a linear 


transformation. 


33. (From Chapter 2) If A, B, and C are matrices and 
AC = BC, then A = B. 
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Answers to Odd-Numbered Exercises and Tests 


Answers to Odd-Numbered Exercises and Tests 


A7 


Chapter 1 
Section 1.1 


1. Linear 3. Not linear 
7.x = 2t 9 x=1-—s- 
y=t y=s 
Z=t 


x=4 
y= 
19. y 


25. x, =5 27. x =3 
xy = y=} 
z=0 


(page 10) 


5. Not linear 


t 


21. 


—x+y=1 


x=2 
YZ 


1 0.05x — 0.03y = 0.07 


29. x, = —-t 
Xo = 2t 
x, =t 


37. 


43. 


49. 


55. 


61. 


63. 


=3 


(b) Inconsistent 


6x+2y=1 
(a) 2x — 8y =3 (b) Consistent 
(c) x= 5 
yr~4 
d) x=3 
i 4 (d) x 2 ; 
y= = 
(e) The solutions are 
= the same. 
5x +y=0 
(a) 4x — 8y =9 (b) Consistent 
3 (c) There are infinitely 
many solutions. 
d) x=2+ 
E j (d) x=3 4+ 2t 
y = t 
(e) The solutions are 
= consistent. 
0.8x — 1.6y = 1.8 
x=-l 39. u = 60 41. x = -} 
==] v = 60 y= —} 
x= 14 45. x, = 47, x =3 
y=-2 ST y=2 
z= 
No solution 51. x, = 3 = it 53. No solution 
x,=4t-1 
x% =t 
x=1 57. x = —1.2 59. x, = —15 
y=0 y = —0.6 x, = 40 
g=3 z = 24 x, = 45 
w=2 x, = —-75 
1 
%55 
Fea dl 
x = 15 
x3 = 9 
This system must have at least one solution because 


x = y = z = Q is an obvious solution. 


Solution: x = 0 
y=0 
z=0 


65. 


This system has exactly one solution. 
This system must have at least one 
x = y = z = Q is an obvious solution. 


: 3 
Solution: x = — 5t 
a4 
y= st 
zat 


solution because 


This system has an infinite number of solutions. 
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A8 Answers to Odd-Numbered Exercises and Tests 


67. Apple juice: 103 mg Section 1.2 (page 22) 


69. 


Orange juice: 124 mg 


(a) True. You can describe the entire solution set using 


parametric representation. 


-3x3 
. Add 5 times the second row to the first row. 


3. 2x4 5.45 


ax + by =c . Interchange the first and second rows, add 3 times the new first 
Choosing y = ¢ as the free variable, the solution is row to the third row. 
a 5 11. x, =0 13.x%,= 2 
— ae y = t, where t is any real number. i= 2 p= =1 
(b) False. For example, consider the system | 
x, +x, +%3,=1 15. x, = 1 17. x, = —26 
X, $x, + x, = 2 x, = 1 v= 13 
which is an inconsistent system. x3 = 0 x= -7 
(c) False. A consistent system may have only one solution. t= 4 
Tl. 3x,-x,= 4 19. Reduced row-echelon form 


—3x, + x, = —4 
(The answer is not unique.) 


21. 
23. 


Not in row-echelon form 
Not in row-echelon form 


pl 25. x=2 27. No solution 
73.x= 3 75. x = = 
24 5-t y=3 
1 29.x= 4 31.x,= 4 
| y=-2 g= 
_ 1 1 x= 2 
P wiete t 2 g 9 33. No solution 35. x = 100 + 96t — 3s 
77. x = cos 0 79. k= +1 y=s 
y = sin @ z= 54 + 52t 
81. Allk #0 83. k = -2 85. k = 1,-2 w=t 
87. (a) Three lines intersecting at one point 37.x=0 39. x, = 23.5361 + 0.5278t 
(b) Three coincident lines y=2-4t x, = 18.5444 + 4.1111¢ 
(c) Three lines having no common point z= x, = 7.4306 + 2.1389t 
89. Answers will vary. (Hint: Choose three different values of x,=t 
x and solve the resulting system of linear equations in the 4. x= 2 43. x, =0 
7 pura a, ona c.) f : x= -2 Xy=-t 
a x—4y=— ee 2 
5x- 6y = 13 14y = 28 e a 
A i x= 1 
+ 45. x = -t 47. $100,000 at 3% 
14y >28 $T X= 8 $250,000 at 4% 
T x, =0 $150,000 at 5% 
beet Nt tt x % =H 
= a L H a 49. Augmented 
= T (a) Two equations in two variables 
-5 + (b) All real k + —į 


Coefficient 
(a) Two equations in three variables 
(b) All real k 


51. (a) atb+c=0 
(b)at+tb+c#0 
(c) Not possible 
J 8 5 18 ou 
HeT AHH ae 3 oh (b) x= 7 
4 -2 F \ 345 y= Fal y= =F Fa 
“3.1. *-4y=-3 z=t z=t 
-= I (c) x =3-t (d) Each system has an 
: ; : y=-3+t infinite number of 
The intersection points are all the same. _ p 
z=t solutions. 
93. x = 39,600 
1 0 
y = 398 55. 0 1 
The graphs are misleading because, while they appear parallel, when 1 o] f1 kl To 11 ro 0 
the equations are solved for y, they have slightly different slopes. 57. 0 Plo ol lo ol lo 0 
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Answers to Odd-Numbered Exercises and Tests 


59. (a) True. In the notation m x n, m is the number of rows of the 
matrix. So, a6 x 3 matrix has six rows. 
(b) True. On page 16, the sentence reads, “Every matrix is 
row-equivalent to a matrix in row-echelon form.” 
(c) False. Consider the row-echelon form 


1 0 0 0 0 

0 1 0 0 1 

0 0 1 0 2 

0 0 0 1 3 
which gives the solution x, = 0,x, = 1,x, = 2, and 
X4 = 3. 


(d) True. Theorem 1.1 states that if a homogeneous system 
has fewer equations than variables, then it must have an 
infinite number of solutions. 

61. Yes, it is possible: 


xX, $x, + x3 =0 


xy FX Fx, = 1 


63. ad- be +0 5214 


67. Sample answer: x + 3z = —2 
yt4z= 1 
2y+ 8z= 2 


69. The rows have been interchanged. The first elementary row 
operation is redundant, so you can just use the second and third 
elementary row operations. 


Section 1.3 (page 32) 


1. (a) p(x) = 29 — 18x + 3x? 


oy 


6 

54 
We Jas 
3 


a+ 
1 


5. (a) p(x) = —3y + 2x2 + t3 
(b) y 


7. (a) p(x) = —6 — 3x + 2 — x2 +24 


(©) 2,28) 7 


[ (1, -8) 


9. (a) Letz = x — 2014. 
plz) = 7 +z + 32 


p(x) = 7 + Hx — 2014) + 3x 
(b) y 


(1, 12) 


(2013) (2014) (2015) 


2014)? 


11. (a) p(x) = 0.254 — 1.579x + 12.022x2 


(b) 1 (0.148, 0.284) 


0.2 440,120, 0.238) 
0-1 (0.072, 0.203) 
peppy ty yt tte x 
—0.2-0.1 0.1 0.2 
4 4 
13. p(x) = =e + * 
sin 3 = ; = 0.889 


(Actual value is \/3/2 = 0.866.) 
15. (x — 5) + (y — 10} = 65 


17. p(x) = 282 + 3(x — 2000) — 0.03(x 
2020: 330 million; 2030: 345 million 
19. (a) Using z = x — 2000 
do Ta, 49a, 343a, = 
ag 8a, 64a, 512a, = 
Ay 9a, 8la, 129a, = 
ag + 10a, + 100a, + 1000a, = 


2000) 


14,065 
17,681 
14,569 
18,760 


(b) p(x) = — 1,378,235 + 500,729.5(x — 2000) 


— 59,488(x — 2000)? + 2338.5(x — 2000)3 


A9 


No. Answers will vary. Sample answer: The model does 


not produce reasonable outcomes 
21. (a) x, = 700 — s — t (b) x, = 600 
x= 300 —s i xX, = 200 


x =s x= 0 
X= 100 —-t x= 0 
xs =t x; = 100 


after 2010. 


(c) x, = 
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A10 Answers to Odd-Numbered Exercises and Tests 


23. (a) x, = 100 + ¢ (b) x, = 100 (c) x, = 200 15. No solution 
x =-100+t x, = —100 =. 0 17.x=0 19. x, = -4 21.2 x3 
x, = 200 + t x, = 200 x; = 300 y=0 p= = 
45t x4 = 0 x4 = 100 23. x, =5 25. x, = —2t 
(d) x, = 400 2 ie X,=t 
xX, = 200 x5 = 0 
x3 = 500 27. Reduced row-echelon form 
X4 = 300 29. Not in row-echelon form 
25. 1, = 0 3l.x= 2 33.x%= 3 35. x =4 +4 3¢ 
ot yo=3 y=; y=5 +2 
hal z= 3 z= 1 z=t 
27, (a) 1, = (b) 4 =0 37. No solution 39.x%,= 1 41. x, = 21.6 
h= n= y= 4 x% = -6.1 
H= p= v=- x, = —0.1 
29. T, = 37.5°, T, = 45°, T; = 25°, T, = 32.5° x 45 j 
ILAS LBS ea 2 43. x =0 45. No solution 47. x,= 2t 
y=2-4t xX, = —3t 
Zt X; = t 
49. x, =0 51. k=+1 
XxX, =0 
x, =0 
53. (a) b = 2aanda # —3 
(b) b # 2a 


(c) a= —3andb = —6 

55. Use an elimination method to get both matrices in reduced 
row-echelon form. The two matrices are row-equivalent 
because each is row-equivalent to 


1 0 0 
0 1 0}. 
0 0 1 
39. Solve the system: 
iy= 0 1 0 =1. =2 2-n 
a ARET > + 2 3 n-1 
os as 5 57.10 0 0 0 0 
pl) =a, +a,+a,=0 . : ; . 
ia eo 0 0 0 © ws, 0 
41. x)=1 + 
: a a= ni 15% 59. (a) False. See page 3, following Example 2. 
Py 5 (b) True. See page 5, Example 4(b). 
l 61. 6 touchdowns, 6 extra-point kicks, 1 field goal 
Y= 63. A =2,B=6,C=4 
65. (a) p(x) = 90 — x + Fe 
b » 
25 
> D ai (4, 20) 
15 
=] 
10 
Review Exercises (page 35) s405 i 
2 : i | | i Hx 
1. Not ad a oe Linear 5. Not linear LoG A 5 
lex =a tana i P 
y=s 67. p(x) = 50 + Fx + 5x? 
= (First year is represented by x = 0.) 
9, x=! 1i. x=-12 i3. x= Fourth-year sales: p(3) = 95 
3 
y= 9 y= = y= 
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69. (a) dy = 80 
a+ 4a, 16a, = 68 
a + 80a, + 6400a, = 30 

(b) and (c) ap = 80 

_ _25 

a, ~~ 3 

a, = 33 


1 25 
So, y = 3X — x + 80. 


(d) The results of parts (b) and (c) are the same. 


(e) There is precisely one polynomial function of degree 


n — 1 (or less) that fits n distinct points. 


71. (a) x, = 100 -—r+t (b) x, = 50 
x, = 300 -—rt+s X = 250 
=r x; = 100 
m= =n x= O 
Xs =S x; = 50 
Xe =t X% = 50 

Chapter 2 

Section 2.1 (page 48) 

1. x= —4,y = 22 

.x=2,y=3 
=2 0 
sols | oli |; 
@) F | ol 7 
0 0 5 3 
4 -2 5 0 4 o=3 
7a Ka & 0 | (b) 3 = | 
42 gp 2 5 -2 
©) | -2 4 @ i -3 a 
K E boo 


9. (a), (b), (d), and (e) Not possible 
12 0 6 
©) |3 -8 ] 
11. (a) ca = —6 (b) ci = 29 
13. x =3,y=2,z=1 


0 15 —2 2 
15. (a) f A o|5 A 


28 =2 =5 9 5 4 
17. (a) 4 8 17 (b) 3. AL =5 
—20 1 4 =17 =I =16 
3 —4 
19. (a) Not possible (b) |10 16 
26 46 
6 4 2 
21. (a) [12] (b) |9 6 3 
0 0 0 
-1 19 
23. (a) 4 -27 (b) Not possible 
0 14 


Answers to Odd-Numbered Exercises and Tests 


3 
25. (a) | 10 (b) Not possible 
26 
60 72 
27. (a) e E (b) Not possible 
60 72 
29. 3 x 4 31. 4x 2 33. 3 x 2 
35. Not possible, sizes do not match. 


43. 


45. 


47. 


49. 


51. 


53. 


61. 
67. 


5 3 
. X% = 1,X = Gt, X3 = Gt 


d dda a | Po 


| 
Ww = 
| 
=. Ù 
> | 
— N 
— 
N'i = t 
a oy es | ee | 
ll 
a i it sr E. 
| 
N 
œo © 


0 -2 5||x, — 16 
x, =] 
X,J}=] 3 
X3 =? 
2e =] xX 3 
0 3 -1 —-I1||x,]}_|-3 
1 0 1 =3||x| |-4 
1 1 2 Glia, 0 


e= [3] + [23] -2i] = 


(The answer is not unique.) 


1 1 -5 3 
b=1/1]+2) oļ|+0 -1ıļ|=ļ1 

2 =j -1 0 
ie E 55. a =7,b = —4,c = —3,d =} 
1 0 0 
0 4 =O 
0 0 9 

-10 0 
ap =| = 

-10 0 
sa =| w 
Proof 63. 2 65. 4 
Proof 69. w=z,x = -y 
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A11 


A12 


71. 


73. 


75. 
79. 


81. 


83. 


85. 


87. 


Let A = he al 


44, n 
Then the given matrix equation expands to 


a Tay, An T -l = È "| 

ai T A Ai T Ag. 0 Ly. 

Because a + a = 1 and a,, + a, = 0 cannot both be 
true, you can conclude that there is no solution. 


„fe ð f-1 o 
@ areal i al=| 0 E 


a 0 1 0 
i a E T 
Proof 77. Proof 
[$1037.50 $1400.00 $1012.50] 
Each entry represents the total profit at each outlet. 
0.40 0.15 0.15 
0.28 0.53- 0.17 
0.32 0.32 0.68 


P? gives the proportions of the voting population that changed 
parties or remained loyal to their parties from the first election 
to the third. 


St 4 0 

=l 1 0 

0 0 5 
(a) True. On page 43, “. . . for the product of two matrices to 


be defined, the number of columns of the first matrix must 
equal the number of rows of the second matrix.” 

(b) True. On page 46, “. . . the system Ax = b is consistent if 
and only if b can be expressed as . . . a linear combination, 
where the coefficients of the linear combination are a 
solution of the system.” 


=1 -4 =2 
AT = 
a | 1 2 | 
=| -2 =3 
eee E: —4 l 
Triangle associated with T Triangle associated with AT 
y. y 
F (2, 4) Pei 
a m 2,3) 47 
2+ > < \ 2+ 
(-1, 1) 
1+ A, D F 
x 
-3-2-1 1.12 3 4 —2-1 L123 4 
-2+ (—4, 2) -2+ 
—34+ -3+ 
ad. =f 


Answers to Odd-Numbered Exercises and Tests 


Triangle associated with AAT 


A 
4-- 
3+ 
2+ 
3; -2) 1461, =1) 
HH 
j- +1234 
=pl = 
3b (-2,-4) 


The transformation matrix A rotates the triangle 90° 
counterclockwise about the origin. 

(b) Given the triangle associated with AAT, the transformation 
that would produce the triangle associated with AT would 
be a 90° clockwise rotation about the origin. Another such 
rotation would produce the triangle associated with T. 


Section 2.2 (page 59) 


1. 


Te 


13. 


15. 


19. 


E = 3 B —4 A s. | 10 l 
15 -1 *{—=12 32 12 “[-59 9 


3 g 0—12 71 1 
p A 2; E Al M. P il 
3 2 ai _ 10 
3 3 3 
(a) - u w| 4 -5 
0 26 16 
7 0 a a 
13 
-14 —4 -6 l 
1 1 
(c) 7-17} @ | -4 -2 
217 232 0o £ 
= 10 Ü -3 -5 -10 
| 2 0 iol z E -5 | 


N 
| 
> 


1 6 =1 
La -2 Ta] a[i 


| 


> 


12 7 2 7 
=) F | (b) E a 


—9 2 —8 4 
"E elsa =| i ;| 
—~pou|2 3 . 
.ac= Bc =|? | 29. Proof 


fo al [0 of slo i 


. (A4 


B)(A — B) = A? + BA — AB — B?, which is not 
necessarily equal to A? — B? because AB is not necessarily 
equal to BA. 


1 -3 5 Bo: rar =|? =| 
39. he i E 41. (AB) = BAT =|} 
4 0 -4 
43. (AB)? = BTAT=|10 4 -2 
i =i 3 
16 8 4 
45.(a)| 8 8 ol ®© ie 3] 
A @ 2 
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Answers to Odd-Numbered Exercises and Tests A13 
68 26-10 6 29-14 5 -5 (c) Bot ; 
a.a 2 41 3 -1] w| 81-3 2 (d) A = 3(A — A7) + 3(A + AY) 
° —10 3 43 5 5 -3 39 13 0 4 -t 2 1 T 
2 2 
6 =l 5 10 =5 2-13 13 1 1 
=|-4 0 =at] 6 5 
1 0 0 0 0 L L 0 7 1 1 
0 1 0 0 0 Sk ti s ti 
49. | 0 0 l 0 0 ew-symmetric ymmetric 
0 0 0 I 0 79. Sample answers: 
0 0 0 0 I (a) An example of a 2 x 2 matrix of the given form is 
0 1 
A, = : 
1 0 0 0 0 lo ol 
0 -1 0 0 0 +3 0 An example of a 4 x 4 matrix of the given form is 
51. | 0 0 1 0 0 53. | 
0 0 0 1 0 - ie j : 
~ A, =|0 0 3). 
0 0 0 0 1 0 0 0 
55. (a) True. See Theorem 2.1, part 1. > _ {0 0 
(b) False. See Theorem 2.6, part 4, or Example 9. iby Aa = Ie ‘| 
(c) True. See Example 10. 0 0 3 0 0 0 
57. (a) a= 3andb = -1 A3 =10 0 0 and A3 =]|0 0 0 
(b) atb=1 0 0 0 0 0 0 
E : (c) The conjecture is that if A is a 4 x 4 matrix of the given 
ss T form, then A? is the 4 x 4 zero matrix. A graphing utility 
No solution shows this to be true. 
(c)atb+c=0 (d) If A is an n x n matrix of the given form, then A” is the 
b+c=0 n X n zero matrix. 
a +c=0 . 
ees eee, eer Section 2.3 (page 71) 
(d) a = —3t 1 0 1 0 
b= kael 1| = 24 3. AB =| t= 84 
emi 1 0 0 i ó 
Lett = lia 3,b=1,c=1 5. AB =|0 1 ol = BA 7. i 
—4 0 3 
59. | l 61-69. Proofs O o 4 j 
me g =2 -19 —33 fee 
71. Skew-symmetric 73. Symmetric 75. Proof 9. E l 11. | a =| 13, | —3 2 =1 
77. (a) 5(A + A?) 3 -3 2 
3 3 1 
ai n in a, 41 ânı 2 2 2 ? 9 
_ 1 [41 a an| |an an Ano 15. Singular 17. 5 -} -3 19. |0 7 0 
pt pt -1 1 1 0 0 & 
a, 1 an2 ann a In an ann 
E ee 3.75 0 1.25 . 2% 
EE ee 21. (54583 -1 -1375| 23\/—, 4 0 
= H421 © A “22 Pon T Enz 4.16 0 —2.5 T ai i 
: : i 20 4 5 
Gn} Ain an2 T Aon 2Any —24 ef 1 =2 
1 az = 
(b) 3(A — A’) 25. Singular 27. = ° 3 F 29. Singular 
a, a in a, 41 ânı 12 -=3 =1 1 
— 1| |021 l2 an| _ | 412 2 an2 5 3 16 15 
: : : : : : 31. i | 33. Does not exist 35. | A ] 
a, 1 an2 Ann a In Aan ann 13 13. 59 59. 
0 an- ay in ~ an 
— 1 41 7 412 0 an T am 
Gn} Ain Am Aan 0 
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A14 Answers to Odd-Numbered Exercises and Tests 


1 0 0 83. Answers will vary. Sample answer: For the system of 
u 3 4 ; 
4 2 equations 
a f 1 32:0 l E aX 2X. A,3x%, = b 
3 5 A u% 12%2 13%3 1 
0 0 9. aX; + da + Gg3X3 = dy 
35 17 2 -7 1 5 31X1 T aah Aaah = b; 
41. (a) (b) (c) write as the matrix equation 
4 10 5 6 _1 3 
2 Ax =b 
138 56 —84 4 6 1 Gy, yy Ay3] |X, b, 
43. (a) gf 37 26-71] (b)g-2 2 4 ai Gog Galal = b 
24 34 3 3 =8 2 a3 ay 33] | X3 b 
4 -2 3 If A is invertible, then the solution is x = A~'!b. 
1 
c) 316 2 =8 : 
O's , a 5 Section 2.4 (page 82) 
45. (a) x= (b) x =2 1. Elementary, multiply Row 2 by 2. 
y=-l1 y=4 3. Elementary, add 2 times Row 1 to Row 2. 
47. (a) x, =1 (b) x, =0 5. Not elementary 
x, =1 = i 7. Elementary, add —5 times Row 2 to Row 3. 
x= = 1 t= = 1 0 0 1 0 0 1 
49. x, =0 51. x, = 1 9. |0 1 0 11. | 0 1 0 
X =1 n= —2 1 0 0 1 0 0 
x3 = 2 x3 = 3 13. Sample answer: 
ah eee 3 sk alk i 7-[! 2 | 
C oe o alli olls 10 -s} lo 1 7 
y a 
53, x=4 55, x E 15. Sample answer: 
1 1 0 O}} 1 0 0 
s7.) 7} 2| 59. Proof; A~! = ke as A 7 4 
"} 3 i i £ cos 0 sin 0 0 1 0) |0 4 00 1 0 
1 6 0 1 
188.24 —117.65 = 11.76 25 0 9 zJ LO o : 
61. F~! = | — 117.65 323.53 —117.65|;w = | 40 1-2 -1 0 = 2s -=l 0 
—11.76 —117.65 188.24 75 -| 0 4 g —4|=lo 1 2 -1 
63-69. Proofs -6 12 8 1 0 0 1 1 
71. (a) True. See Theorem 2.10, part 1. ? 
17. Sample answer: 
(b) False. See Theorem 2.9. 
(c) True. See “Finding the Inverse of a Matrix by Gauss- 1 0 0 0 1 0 0 olf1 0 0 o 
Jordan Elimination,” part 2, page 64. 0 1 o ollo 1 o olo 1.0 0 
73. The sum of two invertible matrices is not necessarily invertible. 0 0- 1 ollo 3 ı ollo 0 ı 0 
For example, let o 0 o ılı 00 1 
1 0 =l 0 0 0 0 1 
A= and B= ; 
0 1 0 =1 1 0 0 
1 0 0 0 j 1 0 0 0 
= oo 2 0 0 Jo 1 o offo 3 O}}-3 1 0 0 
75.(a)| 0 $ ol ®œlo 3 o0 2 0 1 ollo o ı off o0 0 ı 0 
1 4 
0 0 1 0 0 0 0 0 1 0o 0 0 1 0 0 0 1 
0O =I 0 o 0 1 oļf-2 1 0 t=<2 2 
77. (a) Proof (œ) H=}—-1 0 0 0 1 © lj 3=4 O;_ jo 1 -3 
0 0 1 1 0 0 0 -2 2| j0 0 1 
79. A = PDP™! 0 O O 1ij|=1 2 -2 0 0 0 
No, A is not necessarily equal to D. 0 0 I 
81. Answers will vary. Sample answer: For an n x n matrix A, 19 k l 21. 10 1 0 
set up the matrix [A 7] and row reduce it until you have “Ld 0 1 0 0 


[7 A~']. If this is not possible or if A is not square, then A has 
no inverse. If it is possible, then the inverse is A7!. 


Copyright 2017 Cengage Learning. All Rights Reserved. May not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eBook and/or eChapter(s). 
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage Learning reserves the right to remove additional content at any time if subsequent rights restrictions require it. 


25. 


29. 


N=) 


31. 


= 


33. 


35. 


37. 


39. 


41. 


43. 


45. 


47. 


49. 
53. 


Answers to Odd-Numbered Exercises and Tests 


1 0 į} 
0 1 a 
-i 3 27. |0 g 2 
2 2 
0 0 jf 
[i allo “illo 2] 
1 1J LO 1},0 =2 
(The answer is not unique.) 
lo alls o = 
0 1J L3 1},0 =1 
(The answer is not unique.) 
1 0 OJT =2 0 
=i 1 0||0 1 0 
0 0 1/0 0 1 
(The answer is not unique.) 
1 0 0 O}} 1 0 0 0 
0. =1 0 0||0 1 0 0 
0 0 1 0||0 0 2 0 
0 0 0 1/0 0 0 1 
1 0 0 O}} 1 0 0 0 
0 1 0 0||0 1 0 0 
0 0 1 0||0 0 1 0 
0 0 0 —1jjo 0 =1 1 
1 0 0 1}}1 0 0 0 
0 1 0 0||0 1 -3 0 
0 0 1 0||0 0 1 0 
0 0 0 1]{0 0 0 1 


(The answer is not unique.) 


1 ojj 1 1} {1 1 
No. For example, E 4 F i = F l 


a= oo 


(a) True. See “Remark” next to “Definition of an Elementary 
Matrix,” page 74. 

(b) False. Multiplication of a matrix by a scalar is not a single 
elementary row operation, so it cannot be represented by a 
corresponding elementary matrix. 

(c) True. See Theorem 2.13. 


L-2 allo 4] 


(The answer is not unique.) 


1 0 0/|3 0 1 
2 1 ojo 1 =1 
=i 1 1|[0 0 2 


(The answer is not unique.) 


_1 
x= 3 
= 
yr 3 
a) 
t= 3 
Idempotent 51. Not idempotent 
Case 1: b= 1,a=0 


Case 2: b = 0, a = any real number 


55-59. Proofs 


A15 


61. Answers will vary. 


Section 2.5 (page 91) 


1. Not stochastic 3. Stochastic 5. Stochastic 

7. Los Angeles: 25 planes, St. Louis: 13 planes, Dallas: 12 planes 
0.15 0.175 0.1875 

9. X, =|0.17|, X, = | 0.217 |, X; = | 0.2477 
0.68 0.608 0.5648 

11. (a) 350 (b) 475 

13. (a) 25 (b) 44 (c)40 

15. (a) Nonsmokers: 5025; smokers of 1 pack/day or less: 2500; 


17. 


21. 


25. 


27. 


31. 


33. 


35. 


37. 


39. 


41. 


47. 


smokers of more than 1 pack/day: 2475 

(b) Nonsmokers: 5047; smokers of 1 pack/day or less: about 
2499; smokers of 1 pack/day or more: about 2454 

(c) Nonsmokers: about 5159; smokers of 1 pack/day or less: 
about 2478; smokers of 1 pack/day or more: about 2363 


L 
Regular; A 19. Not regular; [i] 
s 43 
2 101 
5 16 
Regular; f 23. Regular; | Tor 
5 a2 
101 
1-t 
Not regular; t),Ost<sl 
0 
145 
5 7 
Regular; 403 29. Regular; 0.2 
94 ` 
499. 0.1 
1 
0.2 7 
(a) os| œ |F 
0.5 4 
5 


Eventually, 20% of the members of the community will make 
contributions and 80% will not. 


Eventually, 200 stockholders will be invested in Stock A, 
550 will be invested in Stock B, and 100 will be invested in 
Stock C. 

Absorbing; S, is absorbing and it is possible to move from S, 
to S, in two transitions and from S, to S, in one transition. 
Absorbing; S, is absorbing and it is possible to move from S; 
or S, to S, in one transition and from S, to $} in two transitions. 


1 
0 0 
1 43. 0 45. 16,875 people 
0 

0 


Sample answer: The entries corresponding to nonabsorbing 
states are 0. 
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A16 Answers to Odd-Numbered Exercises and Tests 


0 0 Review Exercises (page 104) 
49. (a) X= 0.5536 b) X= 0.6554 aie ee es {4 3 8 
0 0 1. | l 3. |14 -10 40 
0.4464 0.3446 0 11 —19 36 —12 48 
0 4 6 3 
2 1 = —4 
E slo 6-10) sP JE- 
51. Yes; *,ostst 0 0 6 2 
ot 2 
/ -3 -1 1)[x, 0 3 
9| 2 4 -5||x,|=|-3)x*=|-¥% 
53. Proof 55. Answers will vary. 1 —2 S| lat 1 _ u 
Section 2.6 (page 102) 1 0 1 2 -3 
TP ae, TA = = 
1. Uncoded:[19 5 12],[12 0 3),[15 14 19], WAT =| 2 1,AA=| 2 5 —4), 
[is 12 94 1 21;[5 4 o] — +s = a Te 
Encoded: — 48, 5, 31, —6, —6, 9, —85, 23, 43, aar =| 1 z 
—27,3, 15, —115, 36, 59, 9, —5, —4 =e 2 
3. HAPPY_NEW_YEAR 5. ICEBERG_DEAD_AHEAD 13. A7=[1 3 —1], ATA = [11] 
7. MEET_ME_TONIGHT_RON 1 3 24 
9. SEPTEMBER_THE_ELEVENTH_WE_WILL_ALWAYS_ AAT=| 3 9 -3 
REMEMBER =i =3 4 
Coal Steel 3 3 ail 
0.1 0.2] Coal 20,000] Coal 20 20 10 
.D= =| 4 L =i x 10 
e ie d Steel B Steel 15. | l 17.) å -4 -24| 49, | l -| | 
F 28 a x -12 
8622.0 | Farmer -5 75 5 


13. X = | 4685.0 | Baker 
3661.4 | Grocer 


15. (a) y 
A 


21. 


(2, 3) 


em 


X 

x 

x3 

L L 1 0 -4 
n| 7 l 29. x#-3 31.10 0 
~ 21 

1 
33. f 


lo l 


(The answer is not unique.) 


1 0 O}} 1 0 O}} 1 1 
b) y=3 +7 b) y=4- 2x 35./0 1 oļlfo 1 -2||o ı 0 
(©) g © 2 o o ajlo o ajlo 1 
19. y = -4 + x 21. y = 1.3 + 0.6x (The answer is not unique.) 
23. y = 0.412x + 3 25. y = —0.5x + 7.5 37 ie | d F "| 
27. (a) y = —1.78x + 127.6 “L 0 -1 0 1 
(b) about 69 (The answer is not unique.) 
29. (a) y = —0.5x + 126 39. i aI F H said | | 
b) 9 o oF [0 1f 0 o0 


(The answer is not unique.) 
41. (a) a =—1  (b)and (c) Proofs 
b= -1 
c= 1 


s[i ill -i 


(The answer is not unique.) 


(c) | Number 100 | 120 | 140 


Actual 75 68 | 55 1 0 olf4 1 0 
Estimated | 76 |66 | 56 45. 0 1 0} 0 3 7] 
The estimated values are close to the actual values. =4 5 1}{|0 0 36 
(d) 41% (e) 172 (The answer is not unique.) 
31. Answers will vary. 47,.x=4,y=1,z=—-1 
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49. 


51. 


53. 


59. 


61. 


63. 


65. 


69. 


71. 
73. 


75. 


77. 


Answers to Odd-Numbered Exercises and Tests 


(a) ie a (b) ee a 


90 100 45 50 
580b,, + 840b,, + 320b;; 128.20 
(a) |560b,, + 420b,, + 160d, 77.60 
860b,, + 1020b,, + 540b,, 178.60 


The first column gives the total sales for gas on each day 
and the second column gives the total profit for each day. 
(b) $384.40 


[e | 55. Stochastic 57. Not stochastic 


3 17 65. 
4 =| hesla a 
12 48 192 
0.375 0.3063 0.2653 
X, = | 0.475 |, X, = | 0.4488 |, X; ~= | 0.4274 
0.150 0.2450 0.3073 
(a) 120 (b) 144 
5 0 
Regular; i 67. Not regular; | 0 
7 1 


3 
7 
: 
7 
Eventually, 3 of the customers will turn in their tickets and 2 

will not. 

Not absorbing; no state is absorbing. 

(a) False. See Theorem 2.1, part 1, page 52. 

(b) True. See Theorem 2.6, part 2, page 57. 

(a) False. The entries must be between 0 and 1 inclusive. 

(b) True. See page 90, Example 7(a). 
Uncoded: [15 14][5 O][9 6][0 
[12 1)[14 4] 

Encoded: 103 44 25 10 57 24 4 2 125 50 62 25 78 32 


2][25 0] 


79. A`! = 3 A ALL_SYSTEMS_GO 
81. .CAN_YOU_HEAR_ME_NOW 
_ [0.20 0.50] , _ [133,333 
83. D= be eal ~ | aaa 
85. y=2- 3r 9 87. y= 2.5x 
89. (a) y = 13.4x + 164 


(b) y = 13.4x + 164; They are the same. 


(c) | Year 2008 | 2009 | 2010 | 2011 | 2012 | 2013 
Actual 270 | 286 | 296 | 316 | 326 | 336 
Estimated | 271 | 285 | 298 | 311 | 325 |338 


The estimated values are close to the actual values. 


Chapter 3 


Section 3.1 (page 116) 

1. 1 3.5 5, 27 7. —24 9. 0 

11.1? - 44-5 

13. (a) M,, = 4 (b) C,, = 4 
M,, = 3 Cy = —3 
M, = 2 Cy = —2 
M» = Cy 1 


A17 


15. (a) M,, = 23 Miz —8 M; = —22 
M3, = 5 My, = -5 M»; = 5 
M, = 7 My, = —22 Mz, = —23 
(b) Cy, = 23 Ch = 8 Cy, = —22 
Cy = -5 Cy = -5 C33 = -5 
C3, = 7 Cy = 22 C33 = —23 
17. (a) 4(—5) + 5(—5) + 6(—5) = —75 
(b) 2(8) + 5(—5) — 3(22) = —75 
19. —58 21. —30 23. 0.002 25, 2x= 3y— 1 
27. 0 29. 65,644w + 62,256x + 12,294y — 24,672z 
31. — 100 33. 29 35. 0.281 37. 19 
39. —24 41. 0 
43. (a) False. See “Definition of the Determinant of a 2 x 2 


Matrix,” page 110. 
(b) True. See “Remark,” page 112. 
(c) False. See “Minors and Cofactors of a Square Matrix,” 


page 111. 
45.x=-1,-4 47.x=-1,4 49.14 =-1+4 3 
51. A = —2,0,or1 53. Proof 55. 18uv — 1 
57. e* 59. 1 — Inx 61. r 
63. wz — xy 65. wz — xy 
67. xy? — x22 ty — x*y + x°z — yz 
69. (a) Proof 
x 0 0 d 
=1 x 0 c 
(b) 0 =1 x b 
0 QO. =] a 
Section 3.2 (page 124) 

1. The first row is 2 times the second row. If one row of a matrix 
is a multiple of another row, then the determinant of the matrix 
is zero. 

3. The second row consists entirely of zeros. If one row of a 


7. 


11. 


13. 


15. 


17. 


matrix consists entirely of zeros, then the determinant of the 
matrix is zero. 


. The second and third columns are interchanged. If two 


columns of a matrix are interchanged, then the determinant of 
the matrix changes sign. 

The first row of the matrix is multiplied by 5. If a row ina 
matrix is multiplied by a scalar, then the determinant of the 
matrix is multiplied by that scalar. 


. A 4 is factored out of the second column and a 3 is factored 


out of the third column. If a column of a matrix is multiplied 
by a scalar, then the determinant of the matrix is multiplied 
by that scalar. 

A 5 is factored out of each column. If a column matrix is 
multiplied by a scalar, then the determinant of the matrix is 
multiplied by that scalar. 

—4 times the first row is added to the second row. If a scalar 
multiple of one row of a matrix is added to another row, then 
the determinant of the matrix is unchanged. 

A multiple of the first row is added to the second row. If a 
scalar multiple of one row is added to another row, then the 
determinants are equal. 

The second row of the matrix is multiplied by — 1. If a row 
of a matrix is multiplied by a scalar, then the determinant is 
multiplied by that scalar. 
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A18 


19. 


21. 


31. 
37. 


The fifth column is 2 times the first column. If one column of 
a matrix is a multiple of another column, then the determinant 
of the matrix is zero. 

=l 23. 8 25. 28 27. 0 
— 1344 33. 136 35. —1100 
(a) True. See Theorem 3.3, part 1, page 119. 
(b) True. See Theorem 3.3, part 3, page 119. 
(c) True. See Theorem 3.4, part 2, page 121. 


29. —59 


39. k 41. 1 43. Proof 
45. (a) cos? 0 + sin? 0 = 1 (b) sin? @ — 1 = —cos? 0 
47. Proof 
Section 3.3 (page 131) 
1.a) 0 ()-1 © E =s] (d) 0 
1 4 3 
3. (a)2 (@)-6 (@)|-1 0 3 (d) —12 
0 2 0 
6 3 =2 2 
2 1 0 1 
5. (a) 3. (@)6 (œ 9 4 -3 8 (d) 18 
8 5 —4 5 
7. —250 9. 54 11. 0 13. —3125 
0 0 
15. (a) =2 (b) -2) (e) F | (d) 0 
0 1 3 
17. (a) 1 = (b) -1) (@)|-1 2 3 (d) -8 
1 2 1 
19. Singular 21. Nonsingular 
23. Singular 25. 27. -$ 29. 5 
31. The solution is unique because the determinant of the 


coefficient matrix is nonzero. 


. The solution is not unique because the determinant of the 


coefficient matrix is zero. 


35. The solution is unique because the determinant of the 
coefficient matrix is nonzero. 
37. k= -1,4 39. k = 24 al. k= +? 
43. (a) 14 (b) 196 (c) 196 (d) 56 (e) 4 
45. (a) —30 (b) 900 (c) 900 (d) —240 (e) -4 
47. (a) 29 (b) 841 (c) 841 (d) 232 (e) $ 
49. (a) —30 (b) 900 (c) 900 (d) -480 (e) -4 
51. (a) 22 (b) 22 (c) 484 «(d)88 (e) 5 
53. (a) —26 (b) —26 (c) 676 (d) —208 (e) -4 
55. (a) —115 (b) —115 (c) 13,225 (d)—1840 (e) -75 
57. (a) 25 (b) 9 (c)=125 (d) 81 
59. Proof 
0 1 1 0 
61 | 0 a and | 0 | 
(The answer is not unique.) 
63. 0 65. Proof 


Answers to Odd-Numbered Exercises and Tests 


67. 


69. 
71. 


73. 
79. 


No; in general, P~'AP + A. For example, let 


Jt 4] 44.73 2 fe? 4 
pei 3er] 2) maal? Jl 


Then you have 


—27 —49 
eM pk 
PAP | 16 Kd # A. 
The equation |P~!AP| = |A| is true in general because 
1 
Peat EAE Pea = AY = M: 
Proof 
(a) False. See Theorem 3.6, page 127. 


(b) True. See Theorem 3.8, page 128. 

(c) True. See “Equivalent Conditions for a Nonsingular 
Matrix,” parts 1 and 2, page 129. 

75. Not orthogonal 77. Orthogonal 

83. Proof 


Orthogonal 
Proof 81. Orthogonal 


Section 3.4 (page 142) 


f 4 -2] | -2 1 
1. aal s 1 =| 3 4 
2 2 
0 0 0 
3. adj(A) =|0 —12 —6], A~! does not exist. 
0 4 2 
7 13 
-7 -12 13 y ee 
5. adj(A)=| 2 3 -5l a'=|-4 -1 3 
2 3 =2 | 2 
3 3 
7 1 9 —-13 
ee I T 1 0 —4 
7. adj(A) = 4 2 -9 10? 
2 =1 9 =5 
7 1 13 
5 5 Log 
7 1 4 
jiao 2 Sra 
4 2 ] W 
9 9 9 
2 1 5 
9 ~9 I -3 
%®x= 1 Wx= 2 12x= } 
= = _ l 
X= 2 raS J= 9: 
15. Cramer’s Rule does not apply because the coefficient matrix 
has a determinant of zero. 
17.x=1 19. x= 1 
1 
y= yra 
g=2 c= 5 
21, x, = —1, x5 = 3,%, = 2 23. x; = —12, x, = 10 
25. x, = 5, x5 3, x3 = 2, x4 1 
4k-3 —4k-1 
ae) ame 
The system will be inconsistent if k = 
29. 3 31. 3 33. Collinear 35. Not collinear 
37. 3y —4x=0 3%x=-2 41.3 43.2 45.10 
47. Not coplanar 49. Coplanar 51. Not coplanar 
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Answers to Odd-Numbered Exercises and Tests 


53. 4x — 10y + 3z = 27 55.x+y+z=0 57. z= —4 
59. Incorrect. The numerator and denominator should be 
interchanged. 
61. (a) a b + c = 156.8 
4a + 2b + c = 161.7 
9a + 3b + c = 177.2 
(b) a = 5.3, b = —11, c = 162.5 
(c) 190 
150 
(d) The polynomial fits the data exactly. 
63. Proof 65. Proof 
=2 
67. Sample answer: |adj(A)| = E i = —2, 
1 0/7! 
AP? l= =-2 
al i =2 
69. Proof 
Review Exercises (page 144) 
1. 10 3. 0 5. 14 Te =6 9. 1620 
11. 82 13. —64 15. =1 17: =1 
19. Because the second row is a multiple of the first row, the 


21. 


23. 


25. 
27. 
33: 


37. 
41. 
43. 
45. 
55. 


57. 
61. 


63. 


65. 
71. 


determinant is zero. 

A —4 has been factored out of the second column and a 3 has 
been factored out of the third column. If a column of a matrix 
is multiplied by a scalar, then the determinant of the matrix is 
also multiplied by that scalar. 


@-1 @-5 oj i] @s 

(a) —35 (b) —42,875 (c) 1225 (d) —875 
(a) -20 ©) -4 2-2 31. -5 

x= 0 35. x; = —3 

X= -4 X= =] 

ka= 4 r= 2 

Unique solution 39. Unique solution 

Not a unique solution 

@) 8 (b)4 (©) 64 (d8 @ż 

Proof 47.0 49. —} Sleu 53. —uv 


Row reduction is generally preferred for matrices with few 
zeros. For a matrix with many zeros, it is often easier to 
expand along a row or column having many zeros. 
i ; i = 
x = 2/4 + nn/2, where n is an integer. 59. [f | 
Unique solution: x = 0.6 
y=0.5 


Unique solution: x, = 5 
x = -3 
x= l 
Xj = 6 y= =2 67. 16 69. x — 2y = —4 


9x + 4y — 3z = 0 


73. 


75. 


77. 


Cumulative Test Chapters 1-3 


A19 


Incorrect. In the numerator, the column of constants, 
=i 
6 
1 


should replace the third column of the coefficient matrix, not 

the first column. 

(a) False. See “Minors and Cofactors of a Square Matrix,” 
page 111. 

(b) False. See Theorem 3.3, part 1, page 119. 

(c) True. See Theorem 3.4, part 3, page 121. 

(d) False. See Theorem 3.9, page 130. 

(a) False. See Theorem 3.11, page 137. 

(b) False. See “Test for Collinear Points in the xy-Plane,” 
page 139. 


(page 149) 


1. Not linear 2. Linear 3.x=ly=-2 
4. X= e = —3;, ty. 2 
5. x 10, y = 20, z 40,w = 12 
6.4, = 5-24.55 =>2+4x% tm = 3 
7. xX, = —258, xX. = 5,xX3 = 2t,x, = t 
8. k= 12 9. x= —3,y=4 
29 23. -17 <i 1 
10. ATA =|23 25 27 n| j i 
17 27 37 6 2 
2 1 =1 0 1 0 =i 
2.7] B| 0 2 of 4o 0 1 
7 a 3 1 9 
0 0 3 53 5 -5 
15.x=%y=-3 16x=4,y=2 


17. 


19. 
20. 
21. 


22. 


24. 
27. 
28. 


29. 


PL I ws 


(The answer is not unique.) 


(a) 14 (b) -10 (œ) E = (d) —140 
(a) 84 (b) gy 
(a) 567 (b)7 (© $ (d) 343 
ae 10 fe 
11 11 11 
1 3 1 = _ _ 
a Sar M 23.a=1,b=0,c=2 
2 5 2 
=m I 11. 
y= +ir+1 25.3x+2y=11 26. 35 


,=3,,=4,=1 

BA = [13,275.00 15,500.00] 

The entries represent the total values (in dollars) of the 
products sent to the two warehouses. 

No; Sample answer: 


of dE det i 
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Answers to Odd-Numbered Exercises and Tests 


Chapter 4 ©) i 
. ta 
Section 4.1 (page 159) 1 
2T (2,1) 
Ty 
Pt ttt 
—4 of 2 
| <3y -2+ 
o È6-3) aI 
(c) E 
a+ 
all (2, 1) 
7.u+v= (3,1) 9. u + v= (-1,—4) 1 y 
t 4 Pot 
5+ 14 1 2 
4+ to H> x T 
O E A 1 
34 r 19. u — v = (—1, 0,4) 
27 + = 
(3, 1) v— u= (1,0, —4) 
[a ° + 21. (6,12,6) 23. (-4,3, 2) 
a, [12345 ci-4 | 25. (a) 
11. v = (-3, 3) 13. v = (-8, — 1) 
i A i 


(2,3) 4 


27. (a) Scalar multiple (b) Not a scalar multiple 
4T 29. (a) (4, —2,—8,1) (b) (8, 12, 24,34) (c) (—4, 4, 13, 3) 
34 42) 31. (a) (—9, 3,2, -3,6) (b) (—2, —18, — 12, 18, 36) 
2 ware (c) (11, -6, —4, 6, —3) 
1 ow 33. (a) (1,6, —5,—3) (b) (—1, —8, 10, 0) 
y (2, 1) 3 1321 
-nR © (-3 11, -5 -37) 
a ie Se 35. (3,-3,-2,1) 37. (4,8,18,-2) 39. (-1,3,6,3) 
41.v=u+w 43. v= 2u+w 45. v= —u 
47. v =u, + 2u, — 3u, 


49. It is not possible to write v as a linear combination of u}, U,, 


and u}. 
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51. 


53. 
57. 


59. 


61. 
65. 


67. 


Answers to Odd-Numbered Exercises and Tests 


3 1 2 
9| =(—1)7|+2/8 
6 4 5 


v = 2u, + u, — 2u, + u; — u; 55. No 
(a) True. Two vectors in R” are equal if and only if their 


corresponding components are equal, that is, u = v if and 


only if vu, = Vy, Uy = Yu a i = V 
(b) False. The vector —v is called the additive inverse of the 
vector v. 
If b = x,a, +: +++ -x,a, is a linear combination of the 
columns of A, then a solution to Ax = b is 
x) 
S=; 
x 


The system Ax = b is inconsistent if b is not a linear 
combination of the columns of A. 

Answers will vary. 63. Proof 

(a) Additive identity 

(b) Distributive property 

(c) Add —Ov to both sides. 

(d) Additive inverse and associative property 

(e) Additive inverse 

(f) Additive identity 

(a) Multiply both sides by c7!. 

(b) Associative property and Theorem 4.3, property 4 
(c) Multiplicative inverse 

(d) Multiplicative identity 


Section 4.2 (page 166) 
1. (0, 0, 0, 0) 
0 0 0 
0 0 0 
: . 0 + Ox + Ox? + 0x3 
3 0 0 0 5. 0 + Ox + Ox? + Ox 
0 0 0 
7. -= (v; Vas v3) = (=v T Vz, =v) 
9. -|2 a1 =| = ee ai w 
Qai aa (33 Tan Tan “a3 
11. — (a + ax + ax? + aX + agx’) 
= -dy — Gx — ax — ay? — at 
13. Vector space 


. Vector space 


. Vector space 
. Proof 
. (a) The set is not a vector space. Axiom 8 fails because 


. Not a vector space; Sample answer: Axiom | fails. 
. Not a vector space; Axiom 4 fails. 

. Vector space 

. Not a vector space; Sample answer: Axiom 6 fails. 


25. Vector space 27. Vector space 


. Not a vector space; Sample answer: Axiom | fails. 
. Not a vector space; Axiom 1 fails. 


35. Vector space 
39. Proof 


(1 + 2)(1, 1) = 3(1, 1) = G, 1) 
1(1, 1) + 2(1, 1) = (1, 1) + 2, 1) = G, 2). 


43. 
47. 


49. 


A21 


(b) The set is not a vector space. Axiom 2 fails because 
(1,2) + (2,1) = (1,0) 
(2,1) + (1, 2) = (2,0). 
(Axioms 4, 5, and 8 also fail.) 

(c) The set is not a vector space. Axiom 6 fails because 
(—1)(1,1) = (I, J1), which is not in R?. (Axioms 
8 and 9 also fail.) 

Proof 45. Answers will vary. 

(a) Add —w to both sides. 

(b) Associative property 


(c) Additive inverse 

(d) Additive identity 

(a) True. See page 161. 

(b) False. See example 6, page 165. 

(c) False. With standard operations on R°, the additive inverse 
axiom is not satisfied. 


51. Proof 
Section 4.3 (page 173) 
1. W is nonempty and W C R4, so you need only check that W is 
closed under addition and scalar multiplication. Given 
CTET X35 0)€W and Or Yz» Y3» o0 Ew 
it follows that 
(x4, Xp, x3, 0) + (4, Yo» Y3, 0) 
= (x, + yy, X + Yn X3 + yz, 0) E W. 
Also, for any real number c and (x,, X», x3, 0) © W, it follows 
that 
elx, X2, X3, 0) = (cx, CX, CX3, 0) E W. 
3. W is nonempty and W C M, ,, so you need only check that W 


11. 


13. 


is closed under addition and scalar multiplication. Given 


0 a 0 a 
= = 
| b, | W and | b J W 


it follows that 
0 a, 0 A | 0 at l 
+ = “|e W. 
a ‘| ie 0 bi + b, 0 1 
Also, for any real number c and 


0 a ; 
3 
| b ‘| W, it follows that 


0 a 0 ca 
. = E 
i p J lo ‘| wW. 


. Recall from calculus that continuity implies integrability; 


W C V. So, because W is nonempty, you need only check 
that W is closed under addition and scalar multiplication. 
Given continuous functions f, g E W, it follows that f + g is 
continuous and f + g E€ W. Also, for any real number c and 
for a continuous function f € W, cf is continuous. So, cf © W. 


. Not closed under addition: 


(0,0, —1) + (0,0, — 1) = (0, 0, —2) 


. Not closed under scalar multiplication: 


21,1) = (V2, V2) 

Not closed under scalar multiplication: 
(—l)e* = -e 

Not closed under scalar multiplication: 
(—2)(, 1, 1) = (-2, —2, —2) 
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A22 Answers to Odd-Numbered Exercises and Tests 


15. Not closed under scalar multiplication: 33. Linearly dependent 35. Linearly independent 
1 0 0 2 0 0 37. Linearly dependent 39. Linearly independent 

210 1 ol=l0 2 0 41. Linearly dependent 43. Linearly independent 

0 0 0 0 0 0 45. Linearly dependent 47. Linearly independent 


49. Linearly dependent 51. Linearly independent 
53. (3,4) — 4(—1, 1) — 3(2, 0) = (0, 0), 


17. Not closed under addition: 


1 (0) (0) 1 0 1 2 0 1 
o 1 of+fo 1 of=fo 2 0 (3,4) = 4(—1, 1) + 3(2, 0) 
0 0 1 0 0 1 0 0 2 (The answer is not unique.) 
19. Not closed under addition: 55. (1, 1, 1) — (1, 1,0) — (0,0, 1) — 0(0, 1, 1) = (0, 0, 0) 
(2, 8) + (3, 27) = (5, 35) (1,1,1) = (1, 1,0) + (0,0, 1) — 0(0, 1, 1) 


(The answer is not unique.) 
57. (a) Alt # 1,—2 (b) Allt# 5 
59. Proof 


21. Not a subspace; not closed under scalar multiplication 
23. Subspace; nonempty and closed under addition and scalar 


multiplication 

25. Subspace; nonempty and closed under addition and scalar 61. Because the matrix 
multiplication 1 2 =] 1 0. =3 

27. Subspace; nonempty and closed under addition and scalar 0 1 1 | row reduces to | 0 1 1 | and 
multiplication 2 5 -l 0 0 0 

29. Subspace; nonempty and closed under addition and scalar -2 -6 0 1 0 =3 
multiplication | I I | row reduces to È 1 il 


31. Not a subspace; not closed under scalar multiplication Sands ih b 
and S, span the same subspace. 
33. Not a subspace; not closed under addition 1 2 SP p 


63. (a) False. See “Definition of Linear Dependence and Linear 


35. Subspace; nonempty and closed under addition and scalar 
Independence,” page 179. 


multiplication : : 
(b) True. Any vector u = (u,, Uy, uz, U4) in R* can be written as 


37. Subspace; nonempty and closed under addition and scalar 
u = u,(1, 0, 0, 0) — u,(0, — 1, 0, 0) + u,(0, 0, 1, 0) 


multiplication 


39. Subspace; nonempty and closed under addition and scalar + u,(0, 0, 0, 1). 
multiplication 65-77. Proofs 
41. Not a subspace; not closed under addition Section 4.5 (page 193) 
43. (a) True. See Theorem 4.5, part 2, page 168. 
(b) True. See Theorem 4.6, page 170. 1. {(1, 0, 0, 0, 0, 0), (0, 1, 0, 0, 0, 0), (0, 0, 1, 0, 0, 0), 
(c) False. There may be elements of W that are not elements (0, 0, 0, 1, 0, 0), (0, 0, 0, 0, 1, 0), (0, 0, 0, 0, 0, 1)} 
of U, or vice-versa. 1 0 0| |0 1 0| |0 0 1 
45-59. Proofs 3. 4} 0 0 0|,| 0 0 0},}0 0 | 
Section 4.4 (page 184) oO © ojlo © Jlo © © 
0 0 0} J0 0 0; J0 0 0 
1. (a) z = 2(2, —1, 3) — (5, 0, 4) 1 0 oļljo ı ojlo o i 
(b) v = $(2, -1, 3) + 35, 0, 4) o o ojlo o oj[o oO Oo 
(c) w = 8(2, — 1,3) — 3(5, 0, 4) 0 0 0] |0 0 0] |0 0 0 
(d) u cannot be written as a linear combination of the given 0 0 0],| 0 0 0],| 0 0 o 
vectors. 1 0 0j [0 1 0} [0 0 1 


3. (a) u = —4(2,0,7) + 3(2, 4, 5) + 0(2, — 12, 13) 
(b) v cannot be written as a linear combination of the given 
vectors. 


(c) w = —4(2, 0, 7) + 4(2,4, 5) + 0(2, — 12, 13) 
(d) z = —4(2, 0, 7) + 5(2, 4, 5) + 0(2, — 12, 13) 


5. {1, x, x7, x3, x4} 
7. S is linearly dependent and does not span R?. 
9. S does not span R?. 


11. S is linearly dependent. 
13. S is linearly dependent and does not span R?. 


5. | 6 — | = 3A —2B 15. S is linearly dependent and does not span R°. 
10 7 17. S does not span R°. 
7. E A H=A XAB 19. S is linearly dependent and does not span R°. 
0 -9 21. S is linearly dependent. 
9. S spans R°. 11. S spans R?. 23. S is linearly dependent. 
13. S does not span R?; line 15. S does not span R?; line 25. S does not span P}. 
17. S does not span R?; line 19. S spans R°. 27. S does not span P}. 
21. S does not span R?; plane 23. S does not span R?; plane 29. S is linearly dependent and does not span P}. 
25. S does not span P}. 27. Linearly independent 31. S does not span M, >. 
29. Linearly dependent 31. Linearly independent 33. S is linearly dependent and does not span M, >. 
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35. 
41. 
47. 
53. 
55. 
61. 


65. 


67. 
69. 
71. 
73. 
75. 
77. 
79. 


Answers to Odd-Numbered Exercises and Tests 


Basis 37. Not a basis 39. Basis 

Basis 43. Not a basis 45. Basis 

Basis 49. Not a basis 51. Basis 

Basis; (8, 3, 8) = 2(4, 3, 2) — (0, 3, 2) + 3(0, 0, 2) 
Not a basis 57. 6 59. 8 

6 63. 3m 


© © OjO © O/O 0 


{(1, 0), (0, 1)}, {(1, 0), (1, 1)3, {(0, 1), (1, 1)} 

{(2, 2,), (1, 0)} 

(a) Line (b) {(2,1)}}  (c) 1 

(a) Line (b) {(2,1,-1)} (œ) 1 

(a) {(2, 1,0, 1), (—1,0,1,0)} (b) 2 

(a) {(0,6,1,-D} () 1 

(a) False. If the dimension of V is n, then every spanning set 
of V must have at least n vectors. 

(b) True. Find a set of n basis vectors in V that will span V and 
add any other vector. 


81-85. Proofs 

Section 4.6 (page 205) 

1. (@) (0, -2),(1, -3) ©) HE 

3. (a) (4,3,1), (1, —4,0) (b) Hie)! A 

5. (a) {(1, 0), (0, 1)} (b) 2 

7. (a) {(1,0,4), (0,1, -5)} (by 2 

9. (a) {(1, 0, 0), (0, 1, 0), (0,0, 1)} (b) 3 

11. (a) {(1, 2, —2, 0), (0,0, 0, 1)} (b) 2 

13. {(1, 0,0), (0, 1, 0), (0,0, 1)} 15. {(1, 1, 0), (0,0, 1)} 
17. {(1, 0, — 1, 0), (0, 1, 0, 0), (0, 0, 0, 1)} 


25. 


29. 


33. 


37. 


. {(1, 0, 0, 0), (0, 1, 0, 0), (0, 0, 1, 0), (0, 0, O, 1)} 


OEM oF me f4E) o: 


O = 


(a) 


CIN ov 


a 
> 
| 
orn 


= 


39. 


= 
| 
e ONN 


—— 
> 

| 
NO Re 

SSS ee eg ee | 

ue YY 
w 
pn 
— 
a 
oo 
b 
pr) 


oooco 


41. 


43. 
45. 
47. 


49. 


51. 


55. 


57. 


59. 


61. 


65. 


67. 
69. 
71. 
73. 


75. 


77. 
79. 
81. 


A23 


(a) rank(A) = 3 
nullity(A) = 2 


=3 4 
1 —2 
(b) 1], 0 
0 2 
0 1 
(c) {(1, 0, 3, 0, —4), (0, 1, — 1, 0, 2), (0, 0, 0, 1, —2)} 
1 |2 0 
2115 1 
(d) abla] 2 
4| |9| |—1 
(e) Linearly dependent (®) (i) Yes (ii) No (iii) Yes 
(a) {((-1, -3,2)} (b) 1 
(a) {(-4, 1, 1,0), (-3,-3,0, 1} (&) 2 
(a) {(8, —9, —6,6)} (b) 1 
Consistent; ‘ 0 +i l 
2 
Consistent; +t|—4 53. Inconsistent 
1 
1 5 =2 
0 0 1 
Consistent; 2| +t] —-6]+s] 0 
—3 —4 0 
0 1 0 


aleoj- La] 


Not in the column space 


—1 1 0 
3) O} + 3/1) = 3 63. Proof 
—2 1 —3 


1 0 0 1 1 0 0 1 
@ l ik al ©) f dae J 


1 0o] [0 0 
(c) lo a i | 
@m (b)r (ec) rr (d) R (e) R” 
Answers will vary. 
(a) Proof (b) Proof (c) Proof 


(a) True. The nullspace of A is the solution space of the 
homogeneous system Ax = 0. 

(b) True. See Theorem 4.16, page 200. 

(a) False. See “Remark,” page 196. 

(b) False. See Theorem 4.19, page 204. 

(c) True. The columns of A become the rows of A’, so the 
columns of A span the same space as the rows of A’. 

(a) 0,n (b) Proof 

(a) Proof (b) Proof 

The rank of the matrix is at most 3, so the four row vectors 

form a linearly dependent set. 
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A24 Answers to Odd-Numbered Exercises and Tests 


Section 4.7 


(page 216) 13 
5 114 $ l 
7 =i 45. 47. 3 49. |3 51. 2 
5 E -1 
1. [3] 3. E 5. E zaj 9 1 0 
2 3 i 53. Yes; When B = B’, P™' = 1, 
55. (a) False. See Theorem 4.20, page 210. 
3 1 0 3 I (b) True. See the discussion before Example 5, page 214. 
11. H 13;, |=1 15. | -1 17. | : j (c) True. See paragraph before Example 1, page 208. 
2 2 =e d 57. QP 
i : 
oe L ji i 3 2 4 Section 4.8 (page 225) 
19. i | As 0 3 0 23. |4 -1 0 1L. bcd 3c 5abd 7b 9c 
-1 -4 0 0 Do =3 11. b,c 13. —xcosx + sinx 15. —2 17... —x 
i i 19. 0 21. 2e% 23. 12 25. e “(cos x — sin x) 
2 = 
0 2 a -4 H N E 27. W = (b — aje“ +H #0 29.W=a#0 
` g 2 i -2 g ` 3 3 4 31. (a) Verify. (b) Linearly independent 
i i (c) y = C, sin 4x + C, cos 4x 
4 3 10 —24 7 1 -2 33. (a) Verify. (b) Linearly dependent (c) Not applicable 
31 5 -1 -6 33 —10 3 0 =l 35. (a) Verify. (b) Linearly independent 
i 11 -3—10 -29 7 3 -2 (c) y = C, + C, sin 2x + C} cos 2x 
12 =3 =l 37. (a) Verify. (b) Linearly dependent 
1 3 5 0 7 (c) Not applicable 
no : 
ô 2 3 4 1 39. (a) Verify. 
11 22 iI ee J Peen J: r 
5 9 19 1 21 b) @(t) = C sin. / Șt cos. / >t; proo 
35. | -3 2 `a 4 2 ©) : L i 
3 5 -4 1 5 41. No. For instance, consider y’ = 1. Two solutions are 
0 -4 -4 0 - y= 7 and y = = + 1. Their sum is not a solution. 
-i L 6 4 l 6 43. Parabola 45. Ellipse 
37. (a) x l (b) (c) Verify. (d) y 
3 73 9 4 3 1 
5+ 
1 1 5 47 
4 5 1 2 2 4 Bal 
39. (a) |-7 -10 -1| (b)}|-3 -4 7 
-2 -2 0 2 1 5 t Hx 
2 2 4 -4 45 
u 
4 3-4 
-4+ 
(c) Verify. (d) | -2 DA 
i 49. Parabola 
48 4 3 17 5 y 
T5 7⁄4 35 2 2 4 i 
41.(a)| 4 10 3] wlk - 73 IT 
6 2 1 6 pop 4 
$5 3 2 $ 0 S341 | 
279 =H 
160 
(c) Verify. (d) à gd 
7 
= 70 = 3 nati 
19 3 44 2 _4 _B 
f - K i F 7 53. Hyperbola 
3 1 
43. (a) | -5 7n B| ©) |-7 -7 -7 y (-3,5) 7 
B2 2 4 4 B3 5 at 
39 B 39 7 2 7 2 T 
22 
F 6L 
. 6 e J 
(c) Verify. (d | 7 1 4+ 
19 1 ale 
T e(2, J 2+ 
H |x T 
1 2 HEHH Hx 
=6 ‘4 -2 1 
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55. 


67. 


71. 


75. 


79. 
83. 
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Ellipse 


EE E S 


T 
-5 -4 -3 -2 -1 


WP OF_, 
4 4 
y y 
A i 
4+ 
YZ.. aT 
hao 
wy? OP 
+ =i 
16 4 
y 
y A 
$ 5+ 


y a+ x 
45° 
| E x 
=2 *< 1 2 
aot E 
Proof 81. (a) Proof 
Answers will vary. 


57. Hyperbola 


69. œ — 1} = 6[y’ +3) 


104 
84 


X. 
A 


y 


(b) Proof 


Answers to Odd-Numbered Exercises and Tests 


Review Exercises 


1. (a) (4, -1, 3) 


5. 


(b) (6, 2, 0) 
(c) (—2, —3, —3) 
(d) (-3, —8, —9) 
G —4, —4) 


9. v = 2u, — u, + 3u, 


3. 


(page 227) 


(a) (3, 1, 4, 4) 
(b) (0, 4, 4, 2) 
(c) (3, —3, 0, 2) 
(d) (9, —7, 2, 7) 


7. (3, —6,0) 


11. v= au, t AA + Ou, 


0 0 Ay, “p 
_|0 0 L24 — | 741 Tin 
13. 042 0o of a =M — Ax 
0 0 Tay Ty 
15. 0 = (0, 0, 0, 0, 0) 
v = (ip ZV» TV3 “Va 85) 
17. Subspace 19. Not a subspace 
21. Subspace 23. Not a subspace 
25. (a) Subspace (b) Not a subspace 
27. (a) Yes (b) Yes (c) Yes 
29. (a) No (b)No (c) No 
31. (a) Yes (b) No (c) No 
33. Basis 35. Not a basis 
37. (a) chal (b) 1 (c) 1 
3 =i 
39. (a) dt i +s E (b)2 @)2 
0 1 
4 
41. (a) jt] -2 (b) 1 (c) 2 
1 
43. (a) {(1, 0), (0, I} (b) 2 
45. (a) {(1, 0, 0), (0, 1,0), (0,0, 1)} (b) 3 
=3.|| | =2 
0 1 
47. (a) all o (b) 2 
1 0 
2i |—1 
3 0 
49. (a) qh} o (b) 2 
0 1 
iy 3 2 2 
si. | 3] 53. H 55. | —1 s| 1 
4 =j -4 
=] 3 
1 1 3 
59. : 61. 0 63. i | 
2 1 
0 0 1 10 23 21 
65. | 0 1 0 67. |11 26 24 
1 0 0 12 27 24 
3 =l 2 -2 
5 = 
o. | i o [2 2] 


A25 


A26 


71. 


73. 


75. 


Tle 
83. 


85. 


87. 
95. 


97. 
99. 


103. 


107. 


Answers to Odd-Numbered Exercises and Tests 


-1 0 =f 0 
(a) | —1 0 0 (b) | -1 0 0 
1 1 1 1 1 
=2 
(c) Verify. (d) 1 
=2 


Basis for W: {x, x, x°} 

Basis for U: {(x — 1), x(x — 1), x(x — 1)} 

Basis for WN U: {x(x — 1), x2(x — 1)} 

No. For example, the set 

{x2 + x, x2 — x, 1} 

is a basis for P}. 

79. Proof 81. Answers will vary. 

(a) True. See discussion above “Definitions of Vector 
Addition and Scalar Multiplication in R”,” page 155. 

(b) False. See Theorem 4.3, part 2, page 157. 

(c) True. See “Definition of a Vector Space” and the 
discussion following, page 161. 


Yes; proof 


(a) True. See discussion under “Vectors in R”,” page 155. 

(b) False. See “Definition of a Vector Space,” part 4, page 161. 

(c) True. See discussion following “Summary of Important 
Vector Spaces,” page 163. 

a, d 89. a 91. e 93. —8 

(a) Verify. (b) Linearly independent 

(c) y(t) = Cye"** + Cyxe7** 


(a) Verify. (b) Linearly dependent (c) Not applicable 
Circle 101. Hyperbola 
y bd 
A A 
8T 37 
6+ 2+ 
(-1, 0) 7 
|e |x 
l i -4 J -2-1 2 
T T> x 
-8 -6 2 4 ot 
44+ =3 F 
Parabola 105. Ellipse 
y y 
A 
1 + 
= == =x 
-6 22.21 | 
-2 + 
-3 + 
-4+ 
(4, =2) -5+ 
^2 1\2 
ni - m =i 109. (x’? = 4(y’ — 1) 


Chapter 5 


Section 5.1 


1. 


Te 
9. 


11. 


13. 


17. 
21. 
23. 
25. 
29. 
31. 


33. 


35. 


37. 


39. 


43. 
49. 
57. 
59. 
61. 
63. 


65. 


67. 


69. 


71. 
73. 


75. 


(page 241) 
J17 


4 
(c) 5 


5/41 


5 3.5/2 O 


(b) 2 


5. (a) 


Z) o ( Fe Fe ya) 


19. 2/2 


(a) -6 (b)13 
(a) 0 (b) 41 
(a) |lul| = 1.0843, 
(c) (—0.9223, —0.1153, 
(e) 1.1756 (f) 0.1025 
(a) llull = 1.7321, |lv|| = 2 
(c) (0, — 0.5774, —0.8165) (d0 (@)3 (f) 4 
(a) |lul| = 3.4641, ||v|] = 3.3166 
(b) (—0.6030, 0.4264, — 0.5222, — 0.4264) 
(c) (—0.5774, —0.5, — 0.4082, — 0.5) 
(d) —6.4495 (e) 12 (f) 11 
|(6, 8) + (3, =2)| = [1€, 9I I. -2 

2 < 10/13 
(1, 1, -2) + (, =3, —2)] = |, 1, — 2), - 3, -2 


= 
2°25 2./21 


1.713 rad (98.13°) 41. = rad (105°) 


(c) 25 (d) (—12,18) (e) —30 
(c)9 (d)0 (e)0 27. -7 
v|| ~ 0.3202 (b) (0, 0.7809, 0.6247) 
0.3689) (d) 0.1113 


(b) (—0.5, 0.7071, —0.5) 


1.080 rad (61.87°) 45. Trad (45°) 47. Orthogonal 


Parallel 51. Neither 
v= (t,s,—2t + s) 
(5, DI < 4, Ol + IG. DI 
J/26<44+ /2 
2, =D < G4, Dll I(0, 1, -2l 
6s ABA 
(2, OP = IG, -DIP + 10, DIP 
a = (V2) + (V2 
(7,1, —2)|? = |8, 4, -2P + 4, 
54 = (/29)? + 5 


(a) -6 (b) 13) (œ&)25 (d isl (e) —30 


0 
(d) lo 
0 


53. Neither 55. v = (t, 0) 


KS 


3, ODI? 


(a)O (b) 14 (c) 6 (e) 0 

Orthogonal; u + v = 0 

(a) False. See “Definition of Length of a Vector in R",” 
page 232. 

(b) False. See “Definition of Dot Product in R",” page 235. 

(a) (u + v) — vis meaningless because u * v is a scalar and v 
is a vector. 

(b) u + (u * v) is meaningless because u is a vector and u + v 
is a scalar. 
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77. 


79. 


81. 
89. 


(= 13). (3 =) 


$11,877.50 


6l. 


Answers to Odd-Numbered Exercises and Tests A27 
(a) |(sin x, cos x)| < ||sin x|| ||cos x|| 
1 T 1 T 1 
=g - 
4 8 4 8 4 


This value gives the total revenue earned from selling the 
hamburgers and hot dogs. 

54.7° 83-87. 
Ax = 0 means that the dot product of each row of A with 
the column vector x is zero. So, x is orthogonal to the row 
vectors of A. 


Proofs 


Section 5.2 (page 251) 
1-7. Proofs 
9. Axiom 4 fails. ((0, 1), (0, 1)) = 0, but (0, 1) # 0. 


11. 
13. 


15. 


17. 
19. 
21. 
23. 
25. 
29. 
31. 
35. 
37. 


39. 


41. 


43. 
47. 
53. 


55. 


57. 


59. 


Axiom 4 fails. ((1, 1), (1, 1)) = 0, but (1, 1) # 0. 

Axiom 1 fails. If u = (1, 1, 1) and v = (1,0, 0) (u,v) = 1 
and (v, u) = 0. 

Axiom 3 fails. If u = (1, 1,1), v = (1,0,0), and c = 2, 
clu, v} = 2 and (cu, v) = 4. 


(a) -33 (b) 5 (c) 13. (d) 2/65 
(a) 15 (b) V57 ©5 (d 2/13 
(a) -25 (b) V53 (© v94 (d V197 
(a) 0 83 © VA (d 3/67 
@) 4 (b) V6 (c)3 (d) Y7 27. Proof 
(a) —15 (b) v35 ©) v10 (d) 5/3 
(a) -5 (b) 39 (c) v5 (d) 3/6 33. Proof 
@) -4 b) I1 © V2 (da) V21 
(a)0 () V2 © V2 @2 
2 /46 2/14 
= b 2 eee pea eS 
@ Z ©) Jz & JE (d) JB 
(a) 2 ~ 0.736 (b) MG = 0.816 
e 3 
e 1 
(c) Pee a 
e 2 1 4 
2.103 rad (120.5°) 45. 1.16 rad (66.59°) 


T o 
5 tad (90°) 
(a) |«(5, 12), (3, 4)) n 


49. 1.23 rad (70.53°) 


I6 126.4] 

(13)(5) 

(b) (5, 12) + (3, A ||, 12)l] + 1G, 9| 

8/5 < 1345 

(—4, 3, 3)| < ||, 1, 5)I||(—4, 3, 3) 
18 < 2/221 

(b) ||(0, 1, 5) + (—4, 3, 3)|| < |](0, 1, 5| + I(—4, 3, 3)|| 

4/6 < /26+ \/34 

(a) |(2x, 1 + 3x?)| < ||2x] |]1 + 32?|| 

0 < (2)(/10) 


(b) |[2x + 1 + 3x?|| < |]2x|] + |1 + 3x2} 


51. S rad (90°) 


< 
3s 


(a) |(0, 1,5) + 


A 
(a) |0(—3) + 3(1) + 2(4) + 1(3)| = 14/35 
ee 
o a va vs 
r 


63. 


65. 


67. 


69. 


73. 
75. 


77. 


81. 
85. 


(b) sin x + cos x|| < 


Viens Veto" 


(a) |(x, e] = [lal lle] 


(b) le + el s [all + lel 


1 132 1 ewes 
V4 2€ S V3 V7e°— 3 


Because 
n/2 
(fg) = Í cos x sin x dx 
—n/2 
1 A n/2 
= > sin’ x =0 
2 W 


f and g are orthogonal. 


The functions f(x) = x and g(x) = (5x — 3x) are orthogonal 


because 


(fg = Í 1568 — 3x) dx 


iH 1 i 
= 5x* — 3x?) dx = =(° J =0. 
if x?) dx zí x3) - 


œ) (3,8) 


we (1, 2) 


(a) (4-40 (b) (5, -3$,35) 
@ G -3-1,-1) ©) (0, -5 -3 ) 
; : 2e* 
proj, f = 0 79. proj. f = 2-1 
proj, f = 0 83. proj, f = —sin 2x 
(a) False. See the introduction to this section, page 243. 


(b) False. ||v|| = 0 if and only if v = 0. 
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A28 Answers to Odd-Numbered Exercises and Tests 


87. (a) (u, v) = 4(2) + 2(2)(—2) = 0 = wandvare orthogonal. l x£]! 2 
, é 45. (x2, 1) = x dx = = => 
(b) y Not orthogonal in the is 3}, 3 
A u= (4, 2) Eucli 1 
at uclidean sense 1 eT! 2 
47. (x, x) = [ x dx = ae z3 
Ag (ee J5 0) ( v30 /30 20) 
` 5.2. ey? 30° 15° 6 
31. {( 2 5 0}, ( E x6) 
azil: Bet oa 6°" 6 9 
v=(2,- __ 
5 3/10 0.2 o). lo 2v5 9 V5 
89-95. Proofs 97. c=} = 1 i 10° w Fn 6s 
1 _ 4 
99. ci = qs Co = 16 101. Proof 55. (a) True. See “Definitions of Orthogonal and Orthonormal 
Section 5.3 (page 263) nei page Aoi: 
(b) False. See “Remark,” page 260. 
1. (a) Yes (b) No (c) Yes 57. Orthonormal 
3. (a) Yes (b) Yes (c) Yes /2 a 6 5 
5, (a) Yes (b) No (c) Yes 59. { 7 (1 +x), TA 2} 
7. (a) No (b) No (c) Yes 61. Orthonormal 63. Proof 65. Proof 
9. (a) Yes (b) No (c) No 67. N(A) basis: {(3, — 1, 2)} 
11. (a) Yes (b) Yes (c) No N(A‘) basis: {(—1, — 1, 1)} 
13. (a) Proof (b) ( J ; 2 Jet ; 1 ) R(A) basis: {(1, 0, 1), (1, 2, 3)} 
J10 /10/’ \ /10’ /10 R(A‘) basis: {(1, 1, — 1), (0, 2, 1)} 
69. Proof 
15. (a) Proof (b) a 2 3 F 2 0, 2 te 
3 re 3 2 2 1 1 1 1 1 1 
f 71. „0, 0J, |0, ,0, , „0, +0), 
17. The set {1, x, x?, x3} is orthogonal because A /2 2° Jah \/2 2 


(1, x) = 0, (1, x2) = 0, (1, x3) = 0, (x, x7) = 0, 


(x, 2) = 0, (2,39) = 0. (2.5.0 )} 


Furthermore, the set is orthonormal because 


F 
37. {8,4 0), $, -4,0 
6 


Ial = 1, [lal] = 1,2l = 1, and |2] = 1. Section 5.4 (page 275) 
So, {1, x, x°, x°} is an orthonormal basis for P. 3 1 y=1+ 2x 3. Not collinear 5. Not orthogonal 
V10 1 
4/13 — A 
ea a 2 i 7. Orthogonal 9. (a) span 0 (b) R? 
13 =2 
19. 21. =2 23, | 2 
TJ 13 JTO 15 1| J0 0 
13 = O| | 1 1 4 
> 11. (a) span oflikl o (b) R 
25. {33.6 -3)} 27. {0, 1), (1,0} oJ [o] [-1 
A AT E) 0 
i 3 ae 13. (a) span {| 1 (b) R° 
31. {(3, —2, 0), (3, $. 0), (0, 0, D} 0 
2 /2 6 /6 6) ( 3 3 3)) 0 : 
33. (oF). (88 6)\ 3°. 3° 3 i i 3 
3 8 
35. (-2 3V2 5 2)} 15. span} | _, 17 |3 19. | $ 
7 14° 14 l : 14 
) 3 l 


a ( 2 7 6 0), ( 50. 3 z 21. N(A) basis: E | 
S-a) We 
7 6 A R(A) basis: MRD 
43. (x, 1) = f ra = zl, =0 S f f | 
3] Lo 
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0 9, (a) 5i — 3j — k 11. (a) (0, —2, —2) 
N(A) basis: 4| —1 (b) —5i + 3j + k (b) (0, 2, 2) 
1 (c) 0 (c) (0, 0, 0) 
= 0 13. (a) (—14, 13, 17) 
R ill- (b) (14, — 13, — 17) 
N(A‘) basis: ipl —1 (c) (0, 0, 0) 
0 1 15. (—2, —2,—1) 17. (-8,-14,54) 19. (—1, -1, -1) 
iT To 21. —i + 123-2k 23. —2i + 3j — k 
alla 25. —8i — 2j + 7k 27. (5, —4, —3) 
R(A) basis: y| f; 29.(2,-1,-1) 34.i—-j-3k 33. i- 5j- 3k 
1} [2 35. (25-3) Ce eee jṣ4 ca" 
ie 33° 3 19 19 19 
R(A™) basis: 5} 0}, 1 39 2 i = jt = k 41. L; + Ik 
olli 7602 7602 7602 J2 s2 


43. 1 45. 6/5 47. 2/83 


51. 1 53. —3 55-65. Proofs 


67. (a) g(x) = -g +x 69. (a) g(x) = He — 7) + 6x 


© 


-3 + (3, —3) è -1+ 


35. y= -x 37. y= ier t Sx +% 71, (0) a) = 2@ - 20 
39. y = 380.4 + 31.394; 976,800 i 4 


2 
41. Iny = —0.14 In x + 5.7 or y = 298.9x7®14 
43. (a) False. The orthogonal complement of R” is {0}. 
(b) True. See “Definition of Direct Sum,” page 267. 0 z 
45. Proof 47. Proof Í 
5 E 
Section 5.5 (page 288) 5 


kista ke aan, 73. (a) g(x) = 0.05 — 0.6x + 1.5x 
(b) 1 
f 
8 
y y 
i 
E oÈ 1 
x x 
75. (a) g(x) = = 
5.ixk=-j 7.) -i-j+k @ so) 
z (b) it+j—k (b) 2 
(c) 0 £ 
T f m 
Ei 2 
-j ; 
f 22 
77. g(x) = 2sinx + sin 2x 4 + sin 3x 
x 
2 4 
79. g(x) = + 4cosx + cos 2x 4 g COS 3x 
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A30 Answers to Odd-Numbered Exercises and Tests 
= 1 —2n fi mel 1 1 2/2 > JT | 
81. 1 1 T T pi ee (ee 3 
a(x) = 5 < J(I + cos x + sin x) 45. @ z b) O O { V3x z (3x + 5x’) 
1 -m : 
83. g(x) a (5 + 8cosx + 4 sin x) 47. {( 1 0, 1 H 1 , 2 , 1 J} 
ae a. 2 a2 6 /6 6 
85. g(x) = (1 + z) — 2 sin x — sin 2x — $ sin 3x he andwerienot uulqued 
87. g(x) = sin 2x 
89. g(x) = 2(sin H mat sme Peed ne) 49-57. Proofs 59. vs =] i} 
l= e7?" j= e7?" n 1 : j o. 
91 a + P DIE + 1 CO8sx + z+] sin jx) ANA (ol 
93. Answers will vary. gsis; 
Review Exercises (page 290) i} 
N(A‘) basis: 4 | 1 
L&a J1I7 O V5 @6 (a 10 | 
3. (a) J6 b) V14 (c) 7 (d) V6 
5.@) V6 0) 3 ©-1 @ J it l 
La JI OT 06 a2 an 
5 3 2 
9. Iv = 38:0 = ( ; ; ) if ; 
V38 V38 38 R(A‘) basis: > | 


29. 


31. 


37. 


39. 
41. 


43. 


. (a) (4,4,3) — (b) (= 


- vl = V6u = ( er 


V6 6 V6 


2,-2,-3) (© (—16, —16, — 12) 


„Jrad (90°) 17, rad (15°) 19. rad (180°) 
. (5, 31,40) 23. Gr—-4s—t47,5,1) 

- (a) —10- (b) 258 

. Triangle bey 


IA 


+G D| = le -3-0] + 16.3.0] 


3/11 _ v41 [85 


2 `A 2 


Cauchy-Schwarz Inequality: 


|(4 =3=1) + 


Kla -3, -1). & 3, 1) < (4-3 -Dl lG 3.o 
J47 J85 
10 < ae = 22.347 


(a) 0 (b) Orthogonal 
(c) Because (f, g) = 0, it follows that (f, g)| < || fll llell- 


(-%.8) 33. (0,5) 35. (8 3 3) 


{( T a T al 
{(0, 5, 5). (1 0, 0), (0, 5, —3)} 
(a) (-1, 4, —2) = 2(0, 2, —2) — (1, 0, —2) 


©) [(0 -z allen A ral 


GCL -2) = 3V2(0,,-5] 
1 1 1 
AET ETA) 
(fg) = [ sin x cos x dx 
= sina | =0 


63. y = —65.5 + 24.65t B + 0.118413; $197.8 billion 
65. (0,0,3) 67. 131+ 6j)-k 6%1 71.6 73.7 


75. (a) g(x) = 2x 
(b) 


71. (a) g(x) == 
(b) 


© = = 
Sy 
ici) 
vila 


79. (a) g(x) 
(b) 


83. (a) True. See Theorem 5.18, page 279. 
(b) False. See Theorem 5.17, page 278. 
(c) True. See discussion before Theorem 5.19, page 283 
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Cumulative Test for Chapters 4 


and5 (page 295) 
1. (a) (3, -7) (b) (3, —6) 
y y 
A A 
i+ I+ 
ttt tt tt ef fff pf 4 4 5 y 
“A Aw=,-2) 78 aN va -367 
SFN al 
-4+ \w=(2,-5) f 
Z5 = 
-6+ Neresi z 3v = (3, —6) 
-7+ e -6+ 
Ra F 
(c) (—6, 16) 
y 
A 
20 + 
16+ 
{2Y — 4w = (-6, 16) 
+++} +++ x 
-8-4 Noy = (2, -4) 
-8 + 
-12+ \4w = (8, -20) 
-16 + 
-20 + e 
2. w = 3v, +v, + $v, 
-2 1 0 
3. | -2| = -2]4] + 3]2 
1 7 5 
4. v =5u, — u, + u, + 2u, — 5u; + 3u, 5. Proof 
6. Yes 7. No 8. Yes 


9. (a) A set of vectors {v,,. . 
the vector equation c,v, +> > 


trivial solution. 
(b) Linearly dependent 


10. (a) A set of vectors {v;,. . . 


.,V,} is linearly independent if 
- + c,V, = 0 has only the 


Answers to Odd-Numbered Exercises and Tests 
0 
: 1 
18. N(A) basis: 4| _ i 
0 
0 
N(A‘) basis: }| 0 
0 
R(A) = R? 
OO} |—-1]]}1 
1 O} }1 
T oe 
R(A‘) basis: ihl ols 
0 1} |i 
-1 
19. span 4| —1 20. Proof 
1 
21. y=%- By 
y 
A 
3 
2 
1 
H HH 
-1+ 456789 
za 
2 36 20 
=F zita A 
L A? B 13" 
a5. 
SGA 
-7+ 
22. (a) 3 (b) One basis consists of the first three rows of A. 
(c) One basis consists of columns 1, 3, and 4 of A. 
2 =3 —2 
1 0 0 
0 5 3 
waklla 
0 1 0 
0 0 1 
(e) No (f) No (g) Yes (h) No 


, V„} in a vector space V is a basis 


for V if the set is linearly independent and spans V. 


—4 0 1 =1 


6 13. 2 0 1 


=S = Sl 1 


-5 (d) 2.21 rad (126.7°) 


v2 [s2 


(b) Yes (c) Yes 
1 0 
=] 0 
11. of 1 12. 
O;|-1 
14. (a) /5 (bo) V29 (o) 
11 
15. D 16. fa, 0, 0), (o. 


17. 4(-3, 2) 


Za 


23. No. Two planes can intersect in a line, but not in a single point. 


24. Proof 


Chapter 6 


Section 6.1 (page 306) 

1. (a) (—1,7) (b) (11, -8) 

3. (a) (—3,22,—5) (b) (1,2,2) 

5. (a) (=14,=7) (b) (1, 1,9 

7. (a) (0,2,1) (b) (—6, 4) 

9. Not linear 11. Linear 13. Not linear 

15. Not linear 17. Linear 19. Linear 21. Linear 


23. T(1, 4) = (—3, 5) 
T(—2, 1) = (-3, -1) 

25. (—1, —5, 5) 

27. (0, —6, 8) 


29. (10,0,2) 31. (2, 3,2) 


33. T: R?=R? 35. T:Rt>Rİ 37. T: R> RB 
39. (a) (—1,—1) @)(=1,-1) © (0,0) 
41. (a) (2, —1,2,2) (b) (-1, 1, -1, -3) 
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A31 


A32 


43. 
45. 


47. 


49. 
51. 
53. 
55. 
57. 


59. 
61. 
65. 
67. 


(a) (—1,9, 9) 
(a) (0,4/2) 
© (- 5 5x3) 


ae! 


) (—4t, —t, 0, t) 


b) (2/3 — 2,2/3 + 2) 


s0 in 0 
Al= | cos we | clockwise rotation through 0 
—sin@ cos 0 
Projection onto the xz-plane 


Not a linear transformation 

Linear transformation 

e e] 

True. D, is a linear transformation and preserves addition and 
scalar multiplication. 


False, because 3 cos 3x # 3 cos x. 

g(x) = 2x7 + 3x + C 63. g(x) = — cosx + C 
(a) -1 b5 © -4 

(a) False, because cos(x; + x5) # cos x; + cos x). 


(b) True. See discussion following Example 10, page 305. 


69. (a) (x,0) (b) Projection onto the x-axis 

71. (a) G(x t+ y),5@+y)) (6) G3) © Proof 
1 I lol 

73. Au = f ] Hl = i d = T(u) 
2 af ax + 3Y 

75. (a) Proof (b) Proof (c) (t,0) (d) (t,£) 

77-83. Proofs 

Section 6.2 (page 318) 


33. 


35. 


37. 


. {ao: ag is real} 
- (a) {(0, 0)} 

. (a) span{(—4, 
- (a) {(0, 0)} 
. (a) span{(— 


. (a) {(0, 0)} 
- (a) {(0, 0)} 


. (a) {(t, — 32): tis real} 
. (a) {(—¢, 0, t): t is real} 


. (a) {(s + 4,8, 


ok? 3. {(0, 0, 0, 0)} 
. {dg — ax + a,x? + a,x: ao, A, A; are real} 


9. {(0, 0)} 
(b) R? 
—2,1)} b) R 
(b) span{(1, — 1, 0), (0, 0, 1)} 
1, 1, 1, 0)} 
—1, 0), (0, 1, 
(b) 0 
(b) 0 
(c) {(4s, 4t, s — t): s and t are real} 

(b) 1 

(d) 1 

(b) 1 
(c) {(s, t, s): sand tare real} (d) 2 
—2t): sand tare real} (b) 2 


(b) span{(1, 0, — 1, 0), (0, 0, 0, 1)} 


(c) R (d) 2 
(d) 2 


(c) {(3t, t): tis real} 


(c) {(2t, —2t, t): tis real} (d) 1 
. (a) {(— 11r, 6t, 4t): tis real} (b) 1 (c) R (dd) 2 
. (a) {(2s — t, t, 4s, — 5s, s): s and t are real} (b) 2 


(c) {(7r, 7s, 7t, 8r + 20s + 2t): r, s, and t are real} 
Nullity = 1 
Kernel: a line 


(d) 3 


Range: a plane 
Nullity = 3 
Kernel: R? 
Range: {(0, 0, 0)} 
Nullity = 0 
Kernel: {(0, 0, 0)} 
Range: R? 


Answers to Odd-Numbered Exercises and Tests 


39. 


41. 
47. 


49. 


51. 


55. 


57. 
59. 
61. 
63. 


65. 


Nullity = 2 
Kernel: {(x, y, z): x + 2y + 2z = 0} (plane) 
Range: {(t, 2t, 2t), t is real} (line) 
2 43. 3 45. 4 
Because |A| = —4 # 0, the homogeneous equation Ax = 0 
has only the trivial solution. So, ker(T) = {(0, 0)} and T is 
one-to-one (by Theorem 6.6). Furthermore, because 
rank(7) = dim(R?) — nullity(7) = 2 — 0 = 2 = dim(R?), 
T is onto (by Theorem 6.7). 
Because |A| = —1 # 0, the homogeneous equation Ax = 0 
has only the trivial solution. So, ker(T) = {(0, 0, 0)} and T is 
one-to-one (by Theorem 6.6). Furthermore, because 
rank(7) = dim(R?) — nullity(7) = 3 — 0 = 3 = dim(R’), 
T is onto (by Theorem 6.7). 
53. One-to-one 
Standard Basis 
{(1, 0, 0, 0), (0, 1, 0, 0), 
(0, 0, 1, 0), (0, 0, 0, 1)} 


One-to-one and onto 
Zero 
(a) (0, 0, 0, 0) 


0 1 0 0 0 

0 0 1 0 0 
(b) 0 OV lory1P)o 

0 0 0 0 1 

0 0 0 0 0 0 
(©) lo i s alle als al il} 
(d) p(x) = 0 {1, x, x2, x} 


(e) (0, 0, 0, 0, 0) {(1, 0, 0, 0, 0), (0, 1, 0, 0, 0), 
(0, 0, 1, 0, 0), (0, 0, 0, 1, 0)} 


The set of constant functions: p(x) = dy 


(a) Rank = 1, nullity =2 (b) {(1, 0, — 2), (1, 2, 0)} 

(a) Rank =n (b) Rank < n 

T(A)=0 => A-AT=O0 > A=A™ 

So, ker(T) = {A: A = AT}. 

(a) False. See “Definition of Kernel of a Linear 


Transformation,” page 309. 
(b) False. See Theorem 6.4, page 312. 
(c) True. See discussion before “Definition of Isomorphism,” 


page 317. 
67. Proof 69. Proof 
Section 6.3 (page 328) 
i 1 0 
i 2 3 0 -2 
sft 2). a) 2 oe co) ae OS 
1 -2 ar ae 0 2-1 
7. (1,4) 9. (=14,0, 4) 
-1 0 
1. | {| (b) (3, -4) 
(c) y 
4 (3, 4) 
4+ e 
th 
t+—++1+>4-+++-++- x 
-4 -2 J+ 2 4 
T(v)/ + 
6 -4+ 
(-3, —4) + 
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-Z1 0 2 3 -1 9 
13. b) (-2, —3 
@) | i Œ t ) Bais 0 -2| œ| 5 
(c) 23 =i 1 -1 
i =i @ Ú 1 
j >x 0 0 1 0 1 
-3 -2 -1 /| 3 : 25. (a) l 2 0 -1 (b) 5 
TO) 0o 0 0 1 =| 
. 2 3), fo 1 
c2 3) 27. A = f ala = F al 
5 i w.a oe ; i 
2 s2 -3 ab 3 — 
D o (0,2/2) =g e2 =o 
15. (a) | 7 (b) (0, 2/2 
v2 v2 31. T(x, y) = (—4x, ty) 33. T is not invertible. 
2 2 35. T(x, X5,%3) = (Xy, —X, + Xy, —X_ + x3) 
© 7 37. (a) and (b) (9,5,4) 39. (a) and (b) (2, —4, —3, 3) 
‘la 2/72) 41. (a) and (b) (9, 16, — 20) 
ee a : TES 
P 43. 45. 
aE a S lo a o 0 0 1 1 
0 0 1 0 0 0 1 
— a ae Se 47. 4 — 3e* — 3xe* 
- 0 0 0 0 
1 V3 1 0 0 0 
17. (a) 2 2| G (3 Bi aa 49. alo + 0 ol D 8-22 +43x4 
v3 1 2 0 0 4 Oo 
2 2 0 0 0 3 
(c) ? 
(1,2) 1 0 0 0 0 0 
0 0 0 1 0 0 
0 1 0 0 0 0 
pea 2-3) 51. (a) 0 0 0 0 i 0 (b) Proof 
: 2 0 0 1 0 0 0 
Tv) / 0o 0 0 0 0 1 
-S "ey 
; a 1 0 0 0 0 0 
1 0 0 0 o 1 0 0 0 
19. (a) |O 1 0j œ (3,2, -2) © 0 0 0 0 1 0 
0 0 -i 0o 1 0 0 0 0 
0o 0 0 1 0 0 
o 0 0 0 0 1 


53. (a) True. See Theorem 6.10 on page 320. 
(b) False. See sentence after “Definition of Inverse Linear 
Transformation,” page 324. 
55. Proof 
57. Sometimes it is preferable to use a nonstandard basis. For 
example, some linear transformations have diagonal matrix 


t | i representations relative to a nonstandard basis. 
i010 Section 6.4 (page 334) 
(b) (is, 76) L 4 
, 4 -3 , =3 3 
1. A’ =|, 3 A=] 3 6 
a 5l -3 3 
1 0 0 
| sa|- ol 7A'=|0 1 0 
I 0 0 1 
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A34 


13. 


15 7 

9 =5 2 3 

a =|26 -14 | a. A’ =|-2 
8 -4 5 ż 


S 


vIe va Y 


WIN wo w= 


Answers to Odd-Numbered Exercises and Tests 


11. (a) Horizontal shear 13. (a) Vertical shear 
y y 
O 3 O > 
e(x, 5x + y) 


(a) k ‘| (b) [v], = | _j} iro = 


A 
——} 


(x, y) 


i 
1 
1 
1 
1 
1 


a 


| e 
4 =i 1 _8 
3 3 3 3 
7 3 1 5 > Xx o(x, y) 
5 2 f ' 5 a ii 
15. b = AEA = 
(o E J ©) [v]; E | [T0]; H 15. {(0, t): t is real} 17. {(t, t): tis real} 
a -J a =l I = 19. {(t, 0): tis real} 21. {(t, 0): tis real} 
(c) A’ = 27 8 Ta 9 5 (d) 5 23. y 25. y 
1 1 1 1 
2 3 7 1 2 : 1 (21) 
7.a | 3 = al © ve=|] ofi]: 
at 1 L = =2 
2 2 2 
1 0 O 1 1 1 } =x 
@os=lo 2 olp =]ı i| @]| o 0-D el (3.0) 1 
O -0 3 0 1 =3 
27. y 29. 9 
19 È A P 12 ‘lie E A 
l4 o0 i ilo-<nll ıı 2 (0, 3) (1, 3) a 
5 0 0 BD 6D 
5 8 0 5 5 10 O;]5 0 O 2 1+ 
21.|10 4 oļ=ļo olls 4 oļllo 4 o 
1 i 
0 12 6 0 0 4 0 9 6j|0 0 3 i p 3 1 
(0, 0) (1, 0) 
=2 0 0 i } ł >= xX SJA 
23. 0 1 0 
0 0 1 31. y 33. i 
25. Proof 27. Proof 29. T, 31-37. Proofs C12) 2 (0, 2) (5 2) 
39. The matrix for 7 relative to B, or relative to B’, is the identity = 
matrix. The matrix for / relative to B and B’ is the square i 
matrix whose columns are the coordinates of v,,.. ., V, : 
relative to the standard basis. -1.0 1 9 
meal eh oo| [3-9 
41. (a) True. See discussion before Example 1, page 330. i : >x } >r 
(b) False. See sentence following the proof of Theorem 6.13, E 7 1 2 
page 332. 
35. y 37. 2 
Section 6.5 (page 341) 
1. (a) G,-5) (b) (2,1) © GO) 
(d) (0, =b) (e) (-c,-d) ® (fa) 
3. (a) (1,0) (b) (3,-1) (c) (0,a) 
(d) (b,0) (e) (d, -0c) ®© (-s,f) 
5. (a) (2x,y) (b) Horizontal expansion 


7. (a) Vertical contraction 


(b) » 
A 


9. (a) Horizontal expansion 


(b) (12x, y) 


7 
(x, y) i 


x 
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Answers to Odd-Numbered Exercises and Tests A35 


41. (a) | (b) Review Exercises (page 343) 


. (a) (2,—-4) (b) (4,4) 

. (a) (0,-1,7) (b) {(t — 3,5 — t, t): tis real} 
. (a) (—1, 5, —5) (b) (—1, 2) 

. Not linear 


; T 1 2 . _ 1 =2 
. Linear, A = E =| 11. Linear, A = E i 


© NOW = 


13. Not linear 
15. Not linear 


2 4 6 8 1012 


0 0 
17. Linear, A = | 0 1 
1 0 0 


or 


19. 7(1, 1) = (3,3), 700, 1) = (1, 1) 


21. 7(—7, 2) = (—2, 2) 
23. (a) T: RÈ =R? (b) (3, — 12) 
(c) {(-3, 32: t): tis real} 
25. (a) T: RP >R? (b) (—2, -4,-5) (c) (2,2, 2) 
27. (a) T: RR —=R? (b) (8, 10,4) (© (1, -1) 
45. Horizontal expansion 47. Horizontal shear 29. y 


2 4 6 8 10 12 


49. Reflection in the x-axis and a vertical expansion (in either 8 
order) 
—3;.5) 6r 
51. Vertical shear followed by a horizontal expansion ( ) / 353) 
53. T(1, 0) = (2,0), T(0, 1) = (0, 3), T2, 2) = (4, 6) y Nd (5, 3) 
y (-5,3) 27 ^ 
(4, 6) 


31. (a) span{(—2, 1, 0, 0), (2, 0, 1, —2)} 
(b) span{(5, 0, 4), (0, 5, 8)} 
N G 33. (a) {0} (b) R 
H M E 35. (a) {0,0}  () 0 (© span{(1, 0,3), (0,1, -3} @ 2 
F DERE 37. (a) {(—3£,3t,)} (b) 1 
(c) span{(1, 0, — 1), (0, 1,2)} (d) 2 


0 0 
a AB 39. 3 41. 2 43. A? = 45. A? = | 
l 2 2 0 
2 2 ` 
A x o 2B 1 47. A'=|0 1 ofa=[! | 
2 0 1 0 
59. (v3 = 1)/2, (3 a 1)/2, 1) 49. T is not invertible. 51. T~'(x, y) = (x, —y) 
(1 Slo =a >) 53. (a) One-to-one (b) Onto (c) Invertible 
; 2 ; 2 55. (a) Not one-to-one (b) Onto (c) Not invertible 


63. 90° about the x-axis 65. 180° about the y-axis 
67. 90° about the z-axis 


0 1 0 ei 

1 =9 || 3 walle =3)/2 =1 

6.| 0 oO —1|;0,-1,-1 6l.]_, 3/=|_3 allo -all3 5 
0 


0 


Se N WwW kuna 


cos 3@ —sin a 
sin3@ cos 30 


55. 


61. 


57. (a) and (b) (0,1,1) 59. A' = ki =i] 


0 
63. (a) A = }0 (b) Answers will vary. 
0 


u un © 


as (c) Answers will vary. 


65. Proof 67. Proof 
69. (a) Proof (b) Rank = 1, nullity = 3 
(c) {1 —x,1 — x7,1 — x} 


le Nile 
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A36 Answers to Odd-Numbered Exercises and Tests 


71. Ker(T) = {v: (v, vo) = 0} 
Range = R 
Rank = 1 
Nullity = dim(V) — 1 
73. Although they are not the same, they have the same dimension 
(4) and are isomorphic. 
75. (a) Vertical expansion 77. (a) Vertical shear 


b) y b) ¥ 
b) A ot 2y) (b) A @ (x, y + 3x) 


t y) t 


ne | >o y) : 


79. (a) Horizontal shear 
(b) » 


(x, y) (x + 5y, y) 
© 


> xX 


83. Y 
A 


85. Reflection in the line y =x followed by a horizontal 


expansion 
v2 v2 4 
2 2 
8.2 £ olo) 
2 2 
0 0 1 
1 0 0 
1 J3 1- /3 441) 
89. | 0 5 J (1 7 3 z 
o = 1 
2 2 
L e J Vi v2 
2 4 4 4 2 4 
1 3 3 /6 J/2 2 
a1 2 4 4 33 4 2 4 
J3 1 1 J3 
v 2 2 0 2 


2 
95. (0, 0, 0), (2 — o), (0, 2, 0), 
( 


2/2 2 /2 
(22) oon (ZZ) 
(0, /2.1 (3 =, 1) 


97. (0,0,0), (1,0, 0,92 (0.2 i), 


2 ae) 
(0 L L3) (i L x3) 
=r bT) 
-1+ 731+ /3 -1+ 7314+ 7 
1, 7 a) » | 0, 7 > 


99. (a) False. See “Elementary Matrices for Linear 
Transformations in R?,” page 336. 
(b) True. See “Elementary Matrices for Linear Transformations 
in R?,” page 336. 
101. (a) False. See “Remark,” page 300. 
(b) False. See Theorem 6.7, page 316. 


Chapter 7 
Section 7.1 (page 356) 
2 off1]_.fiyf2. oyoy_ jo 
f F Ei = FEF allt] z ft 
2 3 1| 1 1 
3. f —1 afo = 2/0], 
0 0 31/0 0 
2 3 1 1 1 
f —1 af-i = —]|-1j, 
0 0 3 0 0 
2 3 105 5 
f = aH = j 
0 0 31/2 2 
(0) 1 ol 1 1 
5. f (0) if = i 
1 0 oll 1 1 


xN 
~ 

© 
© 


lo -2llo]= o] 
ofe -allel = -2e 


9. (a) No (b) Yes (c) Yes 
11. (a) Yes (b) No (c) Yes 
13. à = 1, (t, 0); à = — 1, (0, £) 
15. (a) AA —7)=0 +=(b) A=0,(1,2);A = 7, (3,—1) 
17. (a) A+ IA - 3) =0 

(b) A = —1,(—1, 1);A = 3,0, 1) 
19. (a) 2 —-}=0 (b) A= —4,(1, 1);A = 4, 3,1) 
21. (a) A -2)0 - 4) - 1) =0 
(b) A = 4, (7, —4, 2);A = 2, 1, 0,0);A = 1, (-1, 1, 1) 
23. (a) (A + 3) — 3)? = 0 
(b) A = —3, (1, 1, 3);A = 3, (1, 0, — 1), (1,1,0) 
25. (a) A-AA - 6)A + 2) =0 
(b) A = —2, (3, 2, 0);A = 4, (5, —10, —2); 
A = 6, (1, —2, 0) 
27. (a) (A — 2)?(A — 4)(A + 1) = 0 
(b) A = 2, (1, 0, 0, 0), (0, 1, 0, 0); A = 4, (0, 0, 1, 1); 
A = —1, (0,0, 1, —4) 


(d) No 
(d) Yes 


29. à = -2,1 3LA=-h$ 33A=-1,4,4 
sal na 
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37. 1 = 0,0, 0, 21 39. A = 0, 0, 3, 3 41. A = 2,3, 1 
43. A = —6,5, —4, —4 
45. (a) A, = 3,1, = 4 

(b) By = {(2, — I}, B, = {(, — I} 


3 0 
(c) i | 
47. (a) A, 1A, =1,A,=2 
(b) B, = {(1, 0, 1)}, B, ={@, 1, 0)}, B; = {(1, 1, OF 
=ą 0 0 
(c) | 0 1 0 
0 0 2 
49. 1? — 81 + 15 51. 43 — 5}? + 15A — 27 
53; (a) Trace (b) Determinant 
Exercise of A of A 
15 T 0 
17 2 =3 
19 0 sa 
21 7 8 
23 3 —27 
25 8 —48 
27 T —16 


55-63. Proofs 65. a=0,d=1lora=1,d=0 
67. (a) False. x must be nonzero. 

(b) True. See Theorem 7.2, page 351. 
69. Dim = 3 71. Dim = 1 


d c — © a 
73. Tle) = gle] = e = e) 
75.) = —2,3 + 2x,A = 4,-5 + 10x + 2x7;1 = 6,-14 
1 0 1 1 1 0 
wasal Obl aba=3|. ol 
79. à =0,1 81. Proof 
Section 7.2 (page 366) 


1. (a) P~! -| l -$| Par = k >| 


=] 3 0 =2 
(b) A= 1, -2 
1 2 7 r 
3. (a) P! = | F peme = | l 
Za al 2 
3 3 
(b) à = -1,2 
2 2 {4 
3 3 5 0 0 
5. @) P= =| 0 | OP 'AP=|0 3 o0 
1 1 — 
-} $ 0 0 0 1 
(b) A = 5,3, -1 
1 3 . . 
T P= 2 -1 (The answer is not unique.) 
7 1 =1 
9, P=|—4 0 1| (The answer is not unique.) 
2 0 1 
1 -l 1 
11. P=/1 0 1| (The answer is not unique.) 
3 1 0 


Answers to Odd-Numbered Exercises and Tests A37 


13. A is not diagonalizable. 

15. There is only one eigenvalue, 1 = 0, and the dimension of its 
eigenspace is 1. 

17. There is only one eigenvalue, 1 = 7, and the dimension of its 
eigenspace is 1. 

19. There are two eigenvalues, 1 and 2. The dimension of the 
eigenspace for the repeated eigenvalue 1 is 1. 

21. There are two repeated eigenvalues, 0 and 3. The eigenspace 
associated with 3 is of dimension 1. 

23. 1 = 0, 2; The matrix is diagonalizable. 

25. A = 0, —2; Insufficient number of eigenvalues to guarantee 


diagonalization 
27. {(1, -1), (1 D} 29. {(—1 + x), x} 
= 188: =378 
31. Proof 33. | 126 A 
2 0: =2 
35; | =30. -32 -=2 
3 0 =3 


37. (a) True. See the proof of Theorem 7.4, page 360. 
(b) False. See Theorem 7.6, page 364. 


0 0 1 
39. Yes. P =| 0 1 0 
1 0 0 


41. Yes, the order of elements on the main diagonal may change. 

43-47. Proofs 

49. A = 4 is the only eigenvalue, and a basis for the eigenspace is 
{(1, 0)}, so the matrix does not have two linearly independent 
eigenvectors. By Theorem 7.5, the matrix is not diagonalizable. 


Section 7.3 (page 376) 


1. Not symmetric 


1 1 0 -a 0 0 
3 P=| 0 0 1|), P'AP=| 0 a 0 
-1 1 0 0 0 a 
1 © 1 0 0 0 
5 P=| 0 1 O|, P'AP=|0 a 0 
-1 0 1 0 0 2a 
7. à = 1,dim = 1 9, à = 2, dim = 2 
à = 3, dim = 1 à = 3,dim = 1 
11. à = —2, dim = 2 13. à = —1, dim = 1 
A =4,dim = 1 A=1+4+ /2,dim = 1 
A=1-/2,dim = 1 
15. à = —2, dim = 1 17. à = 1, dim = 1 
A = 3, dim = 2 A = 2, dim = 3 
A = 8,dim = 1 A = 3, dim = 1 


19. Orthogonal 21. Orthogonal 23. Not orthogonal 
25. Orthogonal 27. Not orthogonal 29. Orthogonal 
31. Not orthogonal 33-37. Proofs 

39. Not orthogonally diagonalizable 

41. Orthogonally diagonalizable 


=| 2/2 | m -| V3/3 7 
=f 2/2 2/2 i =Vv63 SBB 


(The answer is not unique.) (The answer is not unique.) 


43. 
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A38 Answers to Odd-Numbered Exercises and Tests 


2 l 2 3 1 3 
3 3 3 J 2 ee Vise 
47. P= L $ 5 (The answer is not unique.) 39. A = 2 „à = r A, = Šp = v10 v10 
TE 3 o3 PEAR ee 
oa ae 2 Jọ Yi0 
" Ee Se 3 
49. | — /3/3 J2/2 6/6 E iv? 
13 3/3 2 2 
23/3 0 6/3 41. A= A, = 4,1, = 16,P = 
. 3/3 7 a J 
(The answer is not unique.) 7 
V2/2 0 2/2 0 3 4 
—./2/2 0 2/2 0 | 16 — A 5 5 
oS 43. A= ,A, = 0,1, = 25, P = 
ae 0 «/2/2 0 2/2 = By A + 3 
0 =/2/2 O 2/2 45. Ellipse, 5x")? + 15(y')2 — 45 = 0 
(The answer is not unique.) 47. Ellipse, (x’)* + 6(y’)? — 36 = 0 
53. (a) True. See Theorem 7.10, page 373. 49. Parabola, 4(y’)? + 4x’ + 8y'’ +4=0 
(b) True. See Theorem 7.9, page 372. 51. Hyperbola, 1 (x’)2 + y} 3/2! /2y' + 6] =0 
55-59. Proofs 
: 3 =l 0 
Section 7.4 (page 391) 53.A=|-1 3 Of, 2x’)? + 4(y')? + 8’)? - 16 =0 
_f20]. _ [10]. f2 ye Ss 
1. X, = 5 »X3 > 10 Ae 1 1 0 0 
84 60 8 55. A=|0 2 1}, x’)? + OG’ + 3’? —1=0 
3. x, =|12],x, = |84 l;t 4 0O 1 2 
6 6 l 57. Maximum: 3; h 59. Maximum: 48; [5] 
400 250 8 i 5 
5.x = 25 n= 100 i 2 Minimum: 2; i Minimum: 25; a 
7") 100)" 251 | 2 
50 50} [1 le as, 
min giclee MEERE [og 
1280 3120 61. Maximum: 11; 1 63. Maximum: 3; 1 
7.x, =| 120|,x, =| 960 es a 
40 30 v2 E 
900 2200 -l a 
9. x, =| 60},x, =| 540 Minimum: —1; v2 Minimum: —3; v2 
50 30 1 e 
ll. y, = Cie” 13.9,=Ce* 15. y, = Ce™ v2 v2 
yo = Cze yz = Ce"? yy = Ce“ 1 1 
y3 = Cye’ J6 E 
17. y, = Ce?" 19. y; = Cie” . 2 _ v2 
= 0.41 = or 65. Maximum: 4; | —= |; Minimum: 0; 0 
y2 = Cye y2 = Qe /6 1 
y3 = Cyes Y3 = Cze" 1 = 
S —9r TFF /2 
Ya = Cye /6 
21. y, = Ce’ — 4C,” 23. y; = Cie! + Ce’ a p 
ya = Cre! ya = —Cie' + Oe” 67. Let P = b ‘| be a 2 x 2 orthogonal matrix such that 
= = = 3 
25. yı z Ce ee ae |P| = 1. Define @ € (0, 27) as follows. 
y= Cae” + ioc (i) Ifa =1,thenc = 0, b = 0, and d = 1, so let 8 = 0. 
J3 = 2C3¢ (ii) Ifa = —1, then c = 0,b = Oandd = —1, so let 0 = x. 
27. y = 3C\e* — 5C," — Cae (iii) If a = Oandc > 0, let 0 = arccos(a),0 < 0 < 7/2. 
Yo = 2Ce*% + 10C,e~* + 203e" (iv) Ifa = Oandc < 0, let 0 = 2x — arccos(a), 
y = 2C,e"* 3n/2 < 0 < 2r. 
29. y =y, + yo 31. y = yp (v) Ifa < Oandc > 0, let 6 = arccos(a), 7/2 < 0 < x. 
z» = Yo yo’ = 3 (vi) Ifa < Oandc < 0, let 0 = 2x — arccos(a), 
y = —4y, n <6 < 37/2. 
1 0 9 5 0 5 In each of these cases, confirm that 
33. F i 35 3 E 37. | al p= kh ‘| = pee 0 —sin l 
c d sin 0 cos 0 


69. Answers will vary. 
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Review Exercises 
1. 


11. 


19. 


21. 
23. 


25. 
27. 
29. 
35. 
39. 


41. 


43. 


45. 


47. 


55. 


. (a) A- 4) - 87? =0 


. (a) (A 


.@ - 120 -3P =0 


Answers to Odd-Numbered Exercises and Tests 


(page 393) 


(a) 2-9=0 @)A=-3,1=3 

(c) A basis for à = —3 is {(1, —5)} and a basis for à = 3 
is {(, 1)}. 

b) 1=4,4=8 

(c) A basis for A = 4 is {(1, —2, —1)} and a basis for A = 8 
is {(4, — 1, 0), 3, 0, 1)}. 

2)(A — 3)A - 1) =0 

b) à =1,}=21=3 

(c) A basis for A = 1 is {(1,2, —1)} a basis for A = 2 is 
{(1, 0, 0)}, and a basis for A = 3 is {(0, 1, 0)}. 

HA=11<34 

(c) A basis for A = 1 is {(1, — 1, 0, 0), (0,0, 1, —1)} and a 
basis for A = 3 is {(1, 1, 0, 0), (0, 0, 1, 1)}. 


P= k A (The answer is not unique.) 


Not diagonalizable 


1 0 1 

e P=10 1 0| (The answer is not unique.) 
1 0 =1 

.@a=-} (b)a=2 (œ az -i 


. A has only one eigenvalue, à = 0, and the dimension of its 


eigenspace is 1. 
A has only one eigenvalue, à = 3, and the dimension of its 
eigenspace is 2. 


0 1 
P= 
[t ol 
The eigenspace corresponding to A = 1 of a matrix A has 
dimension 1, while that of matrix B has dimension 2, so the 


matrices are not similar. 
Both symmetric and orthogonal 


Both symmetric and orthogonal 
Neither 31. Neither 33. Proof 
Proof 37. Orthogonally diagonalizable 
Not orthogonally diagonalizable 
Ss al 
P= s a (The answer is not unique.) 
B5 5 
r 
J2 yA 
1 1 
P=]|0 (The answer is not unique.) 
a xr É 
1 0 0 
1 
l @ 
Ja J2 
P= 0 1 O | (The answer is not unique.) 
at, yl 


2 
51. (%24) 


ac" ate ee 
i 0 2 1 Frrr 4 


59. 


6l. 
65. 
69. 


A39 


A= P a A= bis ka m Fee =| 
20 -4/ 152 -88 1040 —784 

(a) and (b) Proofs 63. Proof 

A=0 67. 1 = Oorl 


(a) True. See “Definitions of Eigenvalue and Eigenvector,” 
page 348. 

(b) False. See Theorem 7.4, page 360. 

(c) True. See “Definition of a Diagonalizable Matrix,’ 
page 359. 


> 


_ [100] _ fas]. f2 
ae | 25 bs 7 E H 
4500 1500 24 
73. x, =| 300|, x, = | 4500 |; ¢| 12 
50 50 1 
1440 6588 
75. X, =| 108|; x, =| 1296 
90 81 
77. y, = 4C,e" 79. y, = Ce” 
yo = Cie” + Coe! yo = CG, 
y3 = Ge ™ 
3 
81. (a) A = 3 (d) y 
z 1 
4 i 
b) P = o 3/2 
1 1 
J2 2 


83. 


85. 


87. 


(c) 5G’? — (y'P = 6 


(a) A= (d) A 


(b) P = 


© wP- oP =4 
| 
|i 


1 
ail 
Maximum: 17; a 
Z2 


Maxi E 
aximum F 


Minimum: 


Minimum: 13; 
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A40 Answers to Odd-Numbered Exercises and Tests 


Cumulative Test for Chapters 6 and 7 1 =1 
(page 397) 21.1 =1,]0|;A =0,;-1f,A=2,| 1 
1. Linear transformation 2. Not a linear transformation E 2 z 
3. dim(R") = 4; dim(R”) = 2 1 
4. (a) (-4,2,0) (b) BA 22. 1 = 1 (three times), | 0 
5. {(s, s, —t, t): s, tare real} 0 
6. (a) span{(0, — 1, 0, 1), (1, 0, — 1, 0)} 1 1 5 3 -1 -5 
(b) span{(1, 0), (0, 1)} (c) Rank = 2, nullity =2 23. P=|0 -1 1 24. P=|2 2 10 
1 1 0 (0) 0 2 0 (0) 2 
T ; 2 8. 10 1 1 
"=i 2 i 25. {(0, 1, 0), (1, 1, 1), (2, 2, 3)} 
1 0: -=1 
1 1 1 
0 =2 3 9 K K 
l o n 10./0 0 0 4. 1. B f2 6 
Ye 0 a.p=| V2 V2) a7 pal ieee 
da l l s3 V6 
11. | 7 i TG, 1) = (0, 0), 7(—2, 2) = (—2, 2) f2 2 1 1 1 
T2 2 J3 A 6 
v3 _1 V3 _, 
D ZO 2 la 28. y, = Cie! 
. (a) 1 B ( ) 1 " 3 yo = Ce” 
2 2 2 3 -8 1800 6300 
w y 29. E a 30. x, =| 120|,x, = | 1440 
c nN 60 48 
37 
31. P is orthogonal when P~! = PT., 32. Proof 
s L3 +3) 0:2) E 
T(v)| 30° 
17 
v 
} t x 
-2 -1 
2 =a], fo 2 
13. T= E E = k J 
=a 2 1 2 1 3 
14. T=]|—1 3 2),7T’=|1 -2 3 
4 0 -=6 1 Z =5 


= 1 2 
15. T~'(x, y) = (4x + 3y, —§x + ty) 


z XT tag Xy TX, — Xz a TX, + Xz 
16. T Koved =( a ae 2 
= =2 
17. 0 1], T(0, 1) = (1,0, 1) 
2 1 


ji = ft 4 
18. @ =| | o) P=|! J 


,_[-7 -15 9 
Gas m Sl 


19. 1 = 5 (repeated), | l 


=f 1 
20. a=s,| if = -15.] 5| 
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Index 


A 


Absorbing 
state, 89 
Markov chain, 89 
Abstraction, 161 
Addition 
of matrices, 41 
properties of, 52 
of vectors, 153, 155, 161 
properties of, 154, 156 
Additive identity 
of a matrix, 53 
of a vector, 157, 161 
properties of, 154, 156, 157 
Additive inverse 
of a matrix, 53 
of a vector, 157, 161 
properties of, 154, 156, 157 
Adjoining two matrices, 64 
Adjoint of a matrix, 134 
inverse given by, 135 
Affine transformation, 180, 344 
Age distribution vector, 378 
Age transition matrix, 378 
Algebra 
Fundamental Theorem of, 351 
of matrices, 52 
Algebraic properties of the cross product, 
278 
Alternative form of the Gram-Schmidt 
orthonormalization process, 262 
Analysis 
of a network, 29-31 
regression, 304 
least squares, 99-101, 265, 271-274 
Angle between two vectors, 235, 239, 246, 
279 
Approximation 
Fourier, 285, 286 
least squares, 281-283 
Area, 132, 279, 288 
Associative property 
of matrix addition, 52 
of matrix multiplication, 54 
of scalar multiplication 
for matrices, 52 
for vectors, 154, 156, 161 
of vector addition, 154, 156, 161 
Augmented matrix, 13 
Axes, rotation of, for a conic, 222, 223 
Axioms 
for an inner product, 243 
for a vector space, 161 


B 
Back-substitution, 6 

Gaussian elimination with, 16 
Balancing a chemical equation, 4 


Basis, 186 
change of, 210 
coordinate matrix relative to, 209 
coordinate representation relative to, 208 
number of vectors in, 190 
ordered, 208 
orthogonal, 254, 259 
orthonormal, 254, 258 
for the row space of a matrix, 196 
standard, 186, 188 
tests in an n-dimensional space, 192 
Bessel’s Inequality, 291 
Block multiplication of matrices, 51 


Cc 


Cancellation properties, 69 
Canonical regression analysis, 304 
Cauchy, Augustin-Louis (1789-1857), 119, 
236 
Cauchy-Schwarz Inequality, 237, 248 
Cayley, Arthur (1821-1895), 43 
Cayley-Hamilton Theorem, 147, 357 
Change of basis, 210 
Characteristic 
equation of a matrix, 351 
polynomial of a matrix, 147, 351 
Circle, standard form of the equation of, 221 
Closed economic system, 97 
Closure under 
vector addition, 154, 156, 161 
vector scalar multiplication, 154, 156, 161 
Coded row matrices, 95 
Codomain of a mapping function, 298 
Coefficient(s), 2, 46 
Fourier, 258, 286 
leading, 2 
matrix, 13 
Cofactor(s), 111 
expanding by, in the first row, 112 
expansion by, 113 
matrix of, 134 
sign pattern for, 111 
Collinear points in the xy-plane, test for, 139 
Column 
matrix, 40 
linear combination of, 46 
of a matrix, 13 
operations, elementary, 120 
rank of a matrix, 199 
space, 195, 312 
subscript, 13 
vector(s), 40, 195 
linear combination of, 46 
Column and row spaces, 198 
Column-equivalent matrices, 120 
Commutative property 
of matrix addition, 52 
of vector addition, 154, 156, 161 


Index A41 


Companion matrix, 394 
Complement, orthogonal, 266 
Components of a vector, 152 
Composition of linear transformations, 322, 
323 
Computational fluid dynamics, 79 
Condition for diagonalization, 360, 364 
Conditions that yield a zero determinant, 121 
Cone, elliptic, 387 
Conic(s) or conic section(s), 221 
rotation of axes, 223, 224 
Consistent system of linear equations, 5 
Constant term, 2 
Constrained optimization, 389 
Contraction in R?, 337 
Contradiction, proof by, A4 
Controllability matrix, 314 
Controllable system, 314 
Coordinate matrix, 208, 209 
Coordinate representation, 208, 209 
Coordinate vector, relative to a basis, 208 
Coordinates, 208, 258 
Coplanar points in space, test for, 140 
Counterexample, A5 
Cramer, Gabriel (1704-1752), 136 
Cramer’s Rule, 130, 136, 137 
Cross product of two vectors, 277 
area of a triangle using, 288 
properties of, 278, 279 
Cryptogram, 94 
Cryptography, 94-96 
Crystallography, 213 
Curve fitting, polynomial, 25-28 


D 


Decoding a message, 94, 96 
Degree of freedom, 164 
Determinant(s), 66, 110, 112, 114 
area of a triangle using, 138 
elementary column operations and, 120 
elementary row operations and, 119 
expansion by cofactors, 113 
of an inverse matrix, 128 
of an invertible matrix, 128 
Laplace’s Expansion of, 112, 113 
of a matrix product, 126 
number of operations to evaluate, 122 
properties of, 126 
of a scalar multiple of a matrix, 127 
of a transpose, 130 
of a triangular matrix, 115 
zero, conditions that yield, 121 
Diagonal 
main, 13 
matrix, 49, 115 
Diagonalizable matrix, 359, 373 
Diagonalization 
condition for, 360, 364 
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A42 Index 


and linear transformations, 365 

orthogonal, of a symmetric matrix, 374 

problem, 359 
Diagonalizing a matrix, steps for, 362 
Difference 

equation, 314 

of two matrices, 41 

of two vectors, 153, 155 
Differential equation(s), 218, 219, 380 
Differential operator, 305 
Dimension(s) 

isomorphic spaces and, 317 

of row and column spaces, 198 

of the solution space, 202 

of a vector space, 191 
Direct sum of two subspaces, 230, 267 
Directed line segment, 152 
Distance 

and orthogonal projection, 250, 269 

between two vectors, 234, 246 
Distributive property 

for matrices, 52, 54 

for vectors, 154, 156, 161 
Domain of a mapping function, 298 
Dot product of two vectors, 235 

and matrix multiplication, 240 
Dynamical systems, 396 


E 


Eigenspace, 350, 355 
Eigenvalue(s), 147, 348, 351, 352, 355 
multiplicity of, 353 
problem, 348 
of similar matrices, 360 
of triangular matrices, 354 
Eigenvector(s), 147, 348, 351, 352, 353 
of A form a subspace, 350 
Electric flux, 240 
Electrical network, 30, 322 
Elementary 
column operations, 120 
matrices, 74, 77 
for linear transformations in R?, 336 
row operations, 14 
and determinants, 119 
representing, 75 
Elimination 
Gaussian, 7 
with back-substitution, 16 
Gauss-Jordan, 19 
finding the inverse of a matrix by, 64 
Ellipse, standard form of the equation of, 221 
Ellipsoid, 386 
Elliptic 
cone, 387 
paraboloid, 387 
Encoding a message, 94, 95 
Encryption, 94 
End-centered monoclinic unit cell, 213 


Entry of a matrix, 13 
Equal vectors, 152, 155 
Equality of matrices, 40 
Equation(s) 
characteristic, 351 
of conic section(s), 141, 221 
of the least squares problem, normal, 271 
of a plane, three-point form of, 140 
Equation(s), linear 
in n variables, 2 
solution of, 3 
solution set of, 3 
system of, 4, 38 
consistent, 5 
equivalent, 6, 7 
homogeneous, 21 
inconsistent, 5, 8, 18 
row-echelon form of, 6 
solution(s) of, 4, 5, 56, 203, 204 
solving, 6, 45 
in three variables, 2 
in two variables, 2 
two-point form of, 139 
Equivalent 
conditions, 78 
for a nonsingular matrix, 129 
for square matrices, summary of, 204 
systems of linear equations, 6, 7 
Error, sum of squared, 99 
Euclidean 
inner product, 243 
n-space, 235 
Euler, Leonhard (1707-1783), Al 
Existence of an inverse transformation, 325 
Expanding by cofactors in the first row, 112 
Expansion 
by cofactors, 113 
of a determinant, Laplace’s, 112, 113 
in R?, 337 
External demand matrix, 98 


F 


Fermat, Pierre de (1601-1665), Al 
Fibonacci, Leonard (1170-1250), 396 
Fibonacci sequence, 396 
Finding 
eigenvalues and eigenvectors, 352 
the inverse of a matrix by 
Gauss-Jordan elimination, 64 
the steady state matrix of a Markov 
chain, 88 
Finite dimensional vector space, 186 
First-order linear differential equations, 380 
Fixed point of a linear transformation, 308, 
341 
Flexibility matrix, 64, 72 
Flux, electric and magnetic, 240 
Force matrix, 64, 72 
Forward substitution, 80 


Fourier, Jean-Baptiste Joseph (1768-1830), 
256, 258, 285 
Fourier 
approximation, 285, 286 
coefficients, 258, 286 
series, 256, 287 
Free variable, 3 
Frequency, natural, 164 
Fundamental subspaces of a matrix, 264, 270 
Fundamental Theorem 
of Algebra, 351 
of Symmetric Matrices, 373 


G 


Gauss, Carl Friedrich (1777-1855), 7, 19 
Gaussian elimination, 7 
with back-substitution, 16 
Gauss-Jordan elimination, 19 
finding the inverse of a matrix by, 64 
General equation of a conic section, 141 
General solution, 219 
Genetics, 365 
Geometric properties of the cross product, 
279 
Geometry of linear transformations in R?, 
336-338 
Global Positioning System, 16 
Gram, Jorgen Pederson (1850-1916), 259 
Gram-Schmidt orthonormalization process, 
254, 259 
alternative form, 262 
Grayscale, 190 


H 


Hamilton, William Rowan (1805-1865), 156 

Heart rate variability, 255 

Hessian matrix, 375 

Homogeneous 
linear differential equation, 218, 219 
system of linear equations, 21, 200 

Hooke’s Law, 64 

Horizontal 
contractions and expansions in R?, 337 
shear in R?, 338 

Householder matrix, 73 

Hyperbola, standard form of the equation 

of, 221 

Hyperbolic paraboloid, 387 

Hyperboloid, 386 

Hypothesis, induction, A2 


l 

i, j, k notation, 232 

Idempotent matrix, 83, 99, 133, 335, 358, 
395 

Identically equal to zero, 188, 219 

Identity 

additive 

of a matrix, 53 
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of a vector, 157, 161 
Lagrange’s, 288 
matrix, 55 
properties of, 56 
property 
additive, for vectors, 154, 156 
multiplicative, for matrices, 52 
multiplicative, for vectors, 154, 156 
scalar, of a vector, 161 
transformation, 300 
If and only if, 40 
Image, 298 
morphing and warping, 180 
Inconsistent system of linear equations, 5, 
8, 18 
Induction 
hypothesis, A2 
mathematical, 115 
Principle of, Al, A2 
proof by, A2, A3 
Inductive definition, 112 
Inequality 
Bessel’s, 291 
Cauchy-Schwarz, 237, 248 
triangle, 239, 248 
Infinite dimensional vector space, 186 
Inheritance, 365 
Initial point of a vector, 152 
Inner product(s), 243 
properties of, 245 
weights of the terms of, 244 
Inner product space, 243, 246, 248 
orthogonal projection in, 249 
Input of an economic system, 97 
Input-output matrix, 97 
Intersection of two subspaces is a subspace, 
170 
Inverse 
additive 
of a matrix, 53 
of a vector, 157, 161 
of a linear transformation, 324, 325 
of a matrix, 62, 66 
determinant of, 128 
finding by Gauss-Jordan elimination, 
64 
given by its adjoint, 135 
properties of, 67 
multiplicative, of a real number, 62 
of a product of two matrices, 68 
property, additive, for vectors, 154, 156 
of a transition matrix, 210 
Invertible, 62 
Isomorphic spaces, 317 
Isomorphism, 317 


J 


Jacobian, 145 
Jordan, Wilhelm (1842-1899), 19 


K 

Kepler, Johannes (1571-1630), 28 

Kepler’s First Law of Planetary Motion, 141 
Kernel, 309, 311 

Key, 94 

Kirchhoff’s Laws, 30 


L 
Ladder network, 322 
Lagrange multiplier, 34 
Lagrange’s Identity, 288 
Laplace, Pierre Simon de (1749-1827), 112 
Laplace transform, 130 
Laplace’s Expansion of a Determinant, 112, 
113 
Lattice, 213 
Leading 
coefficient, 2 
one, 15 
variable, 2 
Least squares, 265 
approximation, 281-284 
method of, 99 
problem, 265, 271 
regression 
analysis, 99-101, 265, 271-274 
line, 100, 265 
Left-handed system, 279 
Legendre, Adrien-Marie (1752-1833), 261 
Legendre polynomials, normalized, 261 
Length, 232, 233, 246 
Leontief, Wassily W. (1906-1999), 97 
Leontief input-output model, 97, 98 
Line 
least squares regression, 99, 265 
reflection in, 336, 346 
Linear approximation, least squares, 282 
Linear combination, 46 
of vectors, 158, 175 
Linear dependence, 179, 185 
and bases, 189 
and scalar multiples, 183 
testing for, 180 
Linear differential equation(s), 218 
solution(s) of, 218, 219 
system of first-order, 380 
Linear equation(s) 
in n variables, 2 
solution of, 3 
solution set of, 3 
system of, 4, 38 
consistent, 5 
equivalent, 6 
homogeneous, 21 
inconsistent, 5, 8, 18 
row-echelon form of, 6 
solution(s) of, 4, 5, 56, 203, 204 
solving, 6, 45 
in three variables, 2 


Index A43 


in two variables, 2 
two-point form of, 139 
Linear independence, 179, 257 
testing for, 180, 219 
Linear operator, 299 
Linear programming, 47 
Linear system, nonhomogeneous, 203 
Linear transformation(s), 299 
composition of, 323, 324 
contraction in R?, 337 
and diagonalization, 365 
differential operator, 305 
eigenvalue of, 355 
eigenvector of, 355 
expansion in R?, 337 
fixed point of, 308, 341 
given by a matrix, 302 
identity, 300 
inverse of, 324, 325 
isomorphism, 317 
kernel of, 309 
magnification in R?, 342 
nullity of, 313 
nullspace of, 311 
one-to-one, 315, 316 
onto, 316 
orthogonal projection onto a subspace, 308 
projection in R°, 304 
properties of, 300 
in R?, 336 
range of, 312 
rank of, 313 
reflection in R?, 336, 346 
rotation in R?, 303 
rotation in R?, 339, 340 
shear in R2, 337, 338 
standard matrix for, 320 
sum of, 344 
zero, 300 
Lower triangular matrix, 79, 115 
LU-factorization, 79 


M 


M m.n Standard basis for, 188 
Magnetic flux, 240 
Magnification in R°, 342 
Magnitude of a vector, 232 
Main diagonal, 13 
Map, 298 
Markov, Andrey Andreyevich (1856-1922), 
85 
Markov chain, 85 
absorbing, 89 
nth state matrix of a, 85 
regular, 87 
with reflecting boundaries, 93 
Mathematical 
induction, 115, Al—A3 
modeling, 273 
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A44 


Index 


Matrix (matrices), 13 


addition of, 41 

properties of, 52 
additive identity for, 53 
additive inverse of, 53 
adjoining, 64 
adjoint of, 134 
age transition, 378 
algebra of, 52 
augmented, 13 
characteristic equation of, 351 
characteristic polynomial of, 351 
coefficient, 13 
of cofactors, 134 
cofactors of, 111 
column, 40 

linear combination of, 46 
column of, 13 
column space of, 195, 312 
column-equivalent, 120 
companion, 394 
controllability, 314 
coordinate, 208, 209 
determinant of, 66, 110, 112, 114 
diagonal, 49, 115 
diagonalizable, 359, 373 
eigenvalue(s) of, 147, 348, 351 
eigenvector(s) of, 147, 348, 351 
elementary, 74, 77 

for linear transformations in R?, 336 
entry of, 13 
equality of, 40 
external demand, 98 
flexibility, 64, 72 
force, 64, 72 
form for linear regression, 101 
fundamental subspaces of, 264, 270 
Hessian, 369 
Householder, 73 
idempotent, 83, 105, 133, 335, 358, 395 
identity, 55, 56 
input-output, 97 
inverse of, 62, 66 

determinant of, 128 

finding by Gauss-Jordan elimination, 

64 

given by its adjoint, 135 

a product of, 68 

properties of, 67 
for a linear transformation, standard, 320 
linear transformation given by, 302 
main diagonal of, 13 
minor of, 111 
multiplication of, 42, 51 

and dot product, 240 

identity for, 55 

properties of, 54 
nilpotent, 108, 358 
noninvertible, 62 
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nonsingular, 62 
equivalent conditions for, 129 
nth root of, 60 
nullity of, 200 
nullspace of, 200 
operations with, 40, 41 
orthogonal, 133, 264, 294, 370 
orthogonally diagonalizable, 373 
output, 97 
partitioned, 40, 46 
product of, 42 
determinant of, 126 
of the quadratic form, 382 
rank of, 199 
real, 13, 40 
reduced row-echelon form of, 15 
row, 40, 94 
row of, 13 
row space of, 195 
basis for, 196 
row-echelon form of, 15 
row-equivalent, 14, 76 
scalar multiple of, 41 
determinant of, 127 
scalar multiplication of, 41 
properties of, 52 
similar, 332, 359 
have the same eigenvalues, 360 
properties of, 332 
singular, 62 
size of, 13 
skew-symmetric, 61, 133, 228 
square of order n, 13 
determinant of, 112 
steps for diagonalizing, 362 
summary of equivalent conditions, 204 
stable, 87 
standard, for a linear transformation, 320 
state, 85 
steady state, 86, 87 
finding, 88 
stiffness, 64, 72 
stochastic, 84 
regular, 87 
symmetric, 57, 169, 368 
Fundamental Theorem of, 373 
orthogonal diagonalization of, 374 
properties of, 368, 372 
of T relative to a basis, 326, 327, 330 
trace of, 50, 308, 357 
transformation, for nonstandard bases, 326 
transition, 210, 212, 330 
of transition probabilities, 84 
transpose of, 57 
determinant of, 130 
properties of, 57 
triangular, 79, 115 
determinant of, 115 
eigenvalues of, 354 


zero, 53 
Method of least squares, 100 
Minor, 111 
Modeling, mathematical, 273 
Morphing, 180 
Multiple regression analysis, 304 
Multiplication of matrices, 42, 51 
and dot product, 240 
identity for, 55 
properties of, 54 
scalar, 41 
properties of, 52 
Multiplicative 
identity property 
for matrices, 52 
for vectors, 154, 156 
inverse of a real number, 62 
Multiplicity of an eigenvalue, 353 
Mutually orthogonal, 254 


N 


Natural frequency, 164 
Negative of a vector, 153, 155 
Network 

analysis, 29-31 

electrical, 30, 322 
Nilpotent matrix, 108, 358 
Noncommutativity of matrix 

multiplication, 55 

Nonhomogeneous linear 

differential equation, 218 

system, solutions of, 203 
Noninvertible matrix, 62 
Nonsingular matrix, 62 

equivalent conditions for, 129 
Nonstandard basis, 209 
Nontrivial 

solutions, 179 

subspaces, 169 
Norm of a vector, 232, 246 
Normal equations of the least squares 

problem, 271 

Normalized Legendre polynomials, 261 
Normalizing a vector, 233 
n-space, 155 

Euclidean, 235 
nth root of a matrix, 60 
nth state matrix of a Markov chain, 85 
nth-order Fourier approximation, 285 
n-tuple, ordered, 155 
Nullity, 200, 313 
Nullspace, 200, 311 
Number of 


operations to evaluate a determinant, 122 


solutions, 5, 21, 56 
vectors in a basis, 190 


O 


Obvious solution, 21 


One-to-one linear transformation, 315, 316 
Onto linear transformation, 316 
Open economic system, 98 
Operation(s) 
elementary column, 120 
elementary row, 14 
and determinants, 119 
representing, 75 
with matrices, 40 
that produce equivalent systems, 7 
standard, in R”, 155 
vector, 153 
Operator 
differential, 305 
linear, 299 
Opposite direction parallel vectors, 232 
Order of a square matrix, 13 
Ordered 
basis, 208 
n-tuple, 155 
pair, 152 
Orthogonal 
basis, 254, 259 
complement, 266 
diagonalization of a symmetric matrix, 374 
matrix, 133, 264, 294, 370 
mutually, 254 
projection, 248, 249, 346 
and distance, 250, 269 
onto a subspace, 308 
set(s), 254, 257 
subspaces, 266, 268 
vectors, 238, 246 
Orthogonally diagonalizable matrix, 373 
Orthonormal, 254, 258 
Output 
of an economic system, 97 
matrix, 98 
Overdetermined system of linear equations, 
38 


P 


P,,, standard basis for, 188 

Parabola, standard form of the equation of, 
221 

Paraboloid, 387 

Parallel vectors, 232 

Parallelepiped, volume of, 289 

Parallelogram, area of, 279 

Parameter, 3 

Parametric representation, 3 

Parseval’s equality, 264 

Particular solution, 203 

Partitioned matrix, 40, 46 

Peirce, Benjamin (1809-1890), 43 

Peirce, Charles S. (1839-1914), 43 

Perpendicular vectors, 238 

Plane, three-point form of the equation of, 
140 


Point(s) 
fixed, 308, 341 
initial, 152 
in R", 155 
terminal, 152 
Polynomial(s), 261, 282 
characteristic, 147, 351 
curve fitting, 25-28 
Population 
genetics, 365 
growth, 378, 379 
states of, 84 
Preimage of a mapped vector, 298 
Preservation of operations, 299 
Primary additive colors, 190 
Prime number, A4 
Principal Axes Theorem, 383 
Principle of Mathematical Induction, Al, A2 
Probability vector, steady state, 394 
Product 
cross, 277 
area of a triangle using, 288 
properties of, 278, 279 
dot, 235 
and matrix multiplication, 240 
inner, 243 
properties of, 245 
space, 243 
weights of the terms of, 244 
triple scalar, 288 
of two matrices, 42 
determinant of, 126 
inverse of, 68 
Projection 
orthogonal, 248, 249, 346 
and distance, 250, 269 
onto a subspace, 268, 308 
in R°, 304 
Proof, A2—A4 
Proper subspace, 169 
Properties of 
additive identity and additive inverse, 157 
cancellation, 69 
the cross product, 278, 279 
determinants, 126 
the dot product, 235 
the identity matrix, 56 
inner products, 245 
inverse matrices, 67 
invertible matrices, 77 
linear transformations, 300 
linearly dependent sets, 182 
matrix addition and scalar multiplication, 
52 
matrix multiplication, 54 
orthogonal matrices, 370 
orthogonal subspaces, 268 
scalar multiplication 
and matrix addition, 52 


Index A45 
and vector addition, 154, 156 
of vectors, 164 
similar matrices, 332 
symmetric matrices, 368, 372 
transposes, 57 
vector addition and scalar multiplication, 
154, 156 
zero matrices, 53 
Pythagorean Theorem, 239, 248 


Q 


QR-factorization, 259, 293 
Quadratic 
approximation, least squares, 283 
form, 382 
Quadric surface, 386, 387 
rotation of, 388 
trace of, 385-387 


R2 
angle between two vectors in, 235 
contractions in, 337 
expansions in, 337 
length of a vector in, 232 
linear transformations in, geometry of, 336 
magnification in, 342 
norm of a vector in, 232 
reflections in, 336, 346 
rotation in, 303 
shears in, 338 
translation in, 308, 343 

R 
angle between two vectors in, 279 
projection in, 304 
rotation in, 339, 340 
standard basis for, 186, 254 

R", 155 
angle between two vectors in, 237 
change of basis in, 210 
coordinate representation in, 208 
distance between two vectors in, 234 
dot product in, 235 
length of a vector in, 232 
norm of a vector in, 232 
standard 

basis for, 186 
operations in, 155 
subspaces of, 171 

Range, 298, 312 

Rank, 199, 313 

Real 
matrix, 13, 40 
number, multiplicative inverse, 62 

Real Spectral Theorem, 368 

Recursive formula, 396 

Reduced row-echelon form of a matrix, 15 

Reflection in R?, 336, 346 

Reflecting boundaries, Markov chain with, 93 
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A46 Index 


Regression 
analysis, 304 
least squares, 99-101, 265, 271-274 
line, least squares, 100, 265 
linear, matrix form for, 101 
Regular 
Markov chain, 87 
Stochastic matrix, 87 
Representation 
basis, uniqueness of, 188 
coordinate, 208, 215 
parametric, 3 
Representing elementary row operations, 
715 
Right-hand rule, 340 
Right-handed system, 279 
Rotation 
of axes, for a conic, 223, 224 
of a quadric surface, 388 
in R?, 303 
in R3, 339, 340 
Row 
equivalence, 76 
matrix, 40, 94 
of a matrix, 13 
rank of a matrix, 199 
space, 195 
basis for, 196 
row-equivalent matrices have the 
same, 196 
subscript, 13 
vector, 40, 195 
Row and column spaces, 198 
Row operations, elementary, 14 
and determinants, 119 
representing, 75 
Row-echelon form, 6, 15 
Row-equivalent matrices, 14, 76 
have the same row space, 196 


S 


Same direction parallel vectors, 232 
Sampling, 172 
Satellite dish, 223 
Scalar, 41, 153, 161 
Scalar multiple 
length of, 233 
of a matrix, 41 
determinant of, 127 
of a vector, 155 
Scalar multiplication 
of matrices, 41 
properties of, 52 
in R”, 155 
of vectors, 153, 155, 161 
properties of, 154, 156, 164 
Schmidt, Erhardt (1876-1959), 259 
Schwarz, Hermann (1843-1921), 236 
Sequence, Fibonacci, 396 
Series, Fourier, 256, 287 


Set(s) 
linearly dependent, 179 
linearly independent, 179 
orthogonal, 254, 257 
orthonormal, 254 
solution, 3 
span of, 174, 178 
spanning, 177 
Sex-linked inheritance, 365 
Shear in R?, 338 
Sign pattern for cofactors, 111 
Similar matrices, 332, 359 
have the same eigenvalues, 360 
properties of, 332 
Singular matrix, 62 
Size of a matrix, 13 
Skew-symmetric matrix, 61, 133, 228 
Solution(s) 
of a homogeneous system, 21, 200 
of a linear differential equation, 218, 219 
of a linear equation, 3 
nontrivial, 179 
set, 3 
space, 200, 202 
of a system of linear equations, 4, 203, 
204 
number of, 5, 56 
trivial, 179 
Solving 
an equation, 3 
the least squares problem, 271 
a system of linear equations, 6, 45 
Span, 174, 177, 179 
Spanning set, 177 
Span(S) is a subspace of V, 178 
Spectrum of a symmetric matrix, 368 
Square matrix of order n, 13 
determinant of, 112 
minors and cofactors of, 111 
steps for diagonalizing, 362 
summary of equivalent conditions for, 204 
Stable matrix, 87 
Standard 
forms of equations of conics, 221 
matrix for a linear transformation, 320 
operations in R”, 155 
spanning set, 177 
unit vector, 232 
Standard basis, 186, 187, 208, 209, 254 
State(s) 
matrix, 85 
of a population, 84 
Steady state, 87, 147, 394 
Steady state matrix, 86, 87 
finding, 88 
Steps for diagonalizing an n x n square 
matrix, 362 
Stiffness matrix, 64, 72 
Stochastic matrix, 84 
regular, 87 


Subscript 
column, 13 
row, 13 
Subspace(s), 168 
direct sum of, 230, 267 
eigenvectors of A form a, 350 
fundamental, of a matrix, 264, 270 
intersection of, 170 
kernel is a, 311 
nontrivial, 169 
orthogonal, 266, 268 
projection onto, 268 
proper, 169 
of R”, 171 
range is a, 312 
sum of, 230 
test for, 168 
trivial, 169 
zero, 169 
Subtraction 
of matrices, 41 
of vectors, 153, 155 
Sufficient condition for diagonalization, 364 
Sum 
direct, 230, 267 
of rank and nullity, 313 
of squared error, 99 
of two linear transformations, 344 
of two matrices, 41 
of two subspaces, 230 
of two vectors, 153, 155 
Summary 
of equivalent conditions for square 
matrices, 204 
of important vector spaces, 163 
Surface, quadric, 386, 387 
rotation of, 388 
trace of, 385 
Symmetric matrices, 57, 169, 368 
Fundamental Theorem of, 373 
orthogonal diagonalization of, 374 
properties of, 368, 372 
System of 
first-order linear differential equations, 
380 
linear equations, 4, 38 
consistent, 5 
equivalent, 6, 7 
homogeneous, 21 
inconsistent, 5, 8, 18 
row-echelon form of, 6 
solution(s) of, 4, 5, 56, 203, 204 
solving, 6, 45 
m linear equations in n variables, 4 


T 
Taussky-Todd, Olga (1906-1995), 234 
Taylor polynomial of degree 1, 282 
Term, constant, 2 

Terminal point of a vector, 152 
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Test for 
a basis in an n-dimensional space, 192 
collinear points in the xy-plane, 139 
coplanar points in space, 140 
linear independence, 180, 219 
a subspace, 168 
Tetrahedron, volume of, 140 
Theorem 
Cayley-Hamilton, 147, 357 
Fundamental 
of Algebra, 351 
of Symmetric Matrices, 373 
Principal Axes, 383 
Pythagorean, 239, 248 
Real Spectral, 368 
Three-by-three matrix, determinant of, 
alternative method, 114 
Three-point form of the equation of a plane, 
141 
Torque, 277 
Trace 
of a matrix, 50, 308, 357 
of a surface, 385-387 
Transformation(s) 
affine, 180, 344 
identity, 300 
linear, 299 
composition of, 322, 323 
contraction in R?, 337 
and diagonalization, 365 
differential operator, 305 
eigenvalue of, 355 
eigenvector of, 355 
expansion in R?, 337 
fixed point of, 308, 341 
given by a matrix, 302 
inverse of, 324, 325 
isomorphism, 317 
kernel of, 309 
magnification in R?, 342 
nullity of, 313 
nullspace of, 311 
one-to-one, 315, 316 
onto, 316 
orthogonal projection onto a subspace, 
308 
projection in R°, 304 
properties of, 300 
in R?, 336 
range of, 312 
rank of, 313 
reflection in R?, 336, 346 
rotation in R?, 303 
rotation in R?, 339, 340 
shear in R2, 338 
standard matrix for, 320 
sum of, 344 
matrix for nonstandard bases, 326 
zero, 300 
Transition matrix, 210, 212, 330 


Transition probabilities, matrix of, 84 
Translation in R?, 308, 343 
Transpose of a matrix, 57 
determinant of, 130 
Triangle 
area, 138, 288 
inequality, 239, 248 
Triangular matrix, 79, 115 
determinant of, 115 
eigenvalues of, 354 
Triple scalar product, 288 
Trivial 
solution, 21, 160, 179 
subspaces, 169 
Two-by-two matrix 
determinant of, 66, 110 
inverse of, 66 
Two-point form of the equation of a line, 139 


U 


Uncoded row matrices, 94 
Undamped system, 164 
Underdetermined system of linear equations, 
38 
Uniqueness 

of basis representation, 188 

of an inverse matrix, 62 
Unit cell, end-centered monoclinic, 213 
Unit vector, 232, 233, 246 
Upper triangular matrix, 79, 115 
V 


Variable 
free, 3 
leading, 2 

Vector(s), 146, 149, 161 
addition, 153, 155, 161 

properties of, 154, 156 
additive identity of, 157 
additive inverse of, 157 
age distribution, 378 
angle between two, 235, 237, 246, 279 
in a basis, number of, 190 
column, 40, 195 
linear combination of, 46 

components of, 152 
coordinates relative to a basis, 208 
cross product of two, 277 
distance between two, 234, 246 
dot product of two, 235 
equal, 152, 155 
initial point of, 152 
inner product of, 243 
length of, 232, 233, 246 
linear combination of, 158, 175 
magnitude of, 232 
negative of, 153, 155 
norm of, 232, 246 
normalizing, 233 
number in a basis, 190 


Index A47 


operations, 153, 155 

ordered pair representation, 152 

orthogonal, 238, 246 

parallel, 232 

perpendicular, 238 

in the plane, 152 

probability, steady state, 394 

projection onto a subspace, 268 

in R”, 155 

row, 40, 195 

scalar multiplication of, 153, 155, 161 
properties of, 154, 156 

space(s), 161 
basis for, 186 
dimension of, 191 
finite dimensional, 186 
infinite dimensional, 186 
inner product for, 243 
isomorphisms of, 317 
spanning set of, 177 
subspace of, 168 
summary of important, 163 

steady state probability, 394 

terminal point of, 152 

unit, 232, 246 

zero, 153, 155 

Vertical 
contractions and expansions in R?, 337 
shear in R?, 338 
Volume, 140, 289 


WwW 

Warping, 180 

Weights of the terms of an inner product, 244 
Work, 248 

Wronski, Josef Maria (1778—1853), 219 
Wronskian, 219 


X 
X-axis 
reflection in, 336 


rotation about, 340 
X-linked inheritance, 365 


Y 

y-axis 
reflection in, 336 
rotation about, 340 


Z 


z-axis, rotation about, 339, 340 
Zero 
determinant, conditions that yield, 121 
identically equal to, 188, 219 
matrix, 53 
subspace, 169 
transformation, 300 
vector, 153, 155 
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Properties of Matrix Addition and Scalar Multiplication 


If A, B, and C are m x n matrices, and c and d are scalars, then the properties below are true. 


1.A+B=Bt+A Commutative property of addition 
2,.A+(B+C)=(A+B)+C Associative property of addition 

3. (cd)A = c(dA) Associative property of multiplication 
4. IASA Multiplicative identity 

5. c(A + B) = cA + cB Distributive property 

6. (c + d)A = cA + dA Distributive property 


Properties of Matrix Multiplication 


If A, B, and C are matrices (with sizes such that the matrix products are defined), and c is 
a scalar, then the properties below are true. 


1. A(BC) = (AB)C Associative property of multiplication 
2. A(B + C) = AB + AC Distributive property 
3. (A + B)C = AC + BC Distributive property 


4. c(AB) = (cA)B = A(cB) 


Properties of the Identity Matrix 
If A is a matrix of size m x n, then the properties below are true. 
1. AL, =A 
2.1,4=A 

Properties of Vector Addition and Scalar Multiplication in R” 


Let u, v, and w be vectors in R”, and let c and d be scalars. 


1. u + visa vector in R” Closure under addition 
2,.u+v=vt+u Commutative property of addition 

3. (utv)+w=ut+(v+w) Associative property of addition 
4,.u+0=u Additive identity property 

5. u + (—u) =0 Additive inverse property 

6. cu is a vector in R”. Closure under scalar multiplication 
7. cu + v) = cu + cv Distributive property 

8. (c + du = cu + du Distributive property 

9. c(du) = (cd)u Associative property of multiplication 
10. l(u) =u Multiplicative identity property 


Summary of Important Vector Spaces 


R = set of all real numbers 
R? = set of all ordered pairs 
R? = set of all ordered triples 
R” = set of all n-tuples 
C(— oœ, co) = set of all continuous functions defined on the real line 
C[a, b] = set of all continuous functions defined on a closed interval [a, b], where a + b 
P = set of all polynomials 
P, = set of all polynomials of degree < n (together with the zero polynomial) 
= set of all m x n matrices 
M,,,, = set of alln x n square matrices 
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Summary of Equivalent Conditions for Square Matrices 


If A is ann x n matrix, then the conditions below are equivalent. 
A is invertible. 

Ax = b has a unique solution for any n x 1 matrix b. 

Ax = 0 has only the trivial solution. 

A is row-equivalent to J,,. 

|A| #0 

. Rank(A) =n 

The n row vectors of A are linearly independent. 

The n column vectors of A are linearly independent. 


SIAN KRWNS 


Properties of the Dot Product 


If u, v, and w are vectors in R” and c is a scalar, then the properties listed below are true. 
usv=veru 

u-(vt+tw)=u-vtu-w 

clu + v) = (cu) + v = u= (cy) 

vow = [VIP 

ve v = 0,andv- v = 0 if and only if v = 0. 


Wee 


Properties of the Cross Product 


If u, v, and w are vectors in R? and c is a scalar, then the properties listed below are true. 
uxv=—(v xu) 

u x (v + w) = (ux v) + (u x w) 

clu x vy) =cuxv=uxcv 

ux0=0xu=0 

uxu=0 

u. (vxw) =(uxv)ew 


Oe ae 


Finding Eigenvalues and Eigenvectors* 


Let A be ann X n matrix. 

1. Form the characteristic equation |AJ — A| = 0. It will be a polynomial equation of 
degree n in the variable 1. 

2. Find the real roots of the characteristic equation. These are the eigenvalues of A. 

3. For each eigenvalue J,, find the eigenvectors corresponding to A, by solving the 
homogeneous system (A,J — A)x = 0. This can require row-reducing an n x n matrix. 
The reduced row-echelon form must have at least one row of zeros. 


*For complicated problems, this process can be facilitated with the use of technology. 
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